&&&& RUNNING TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=resnet50-original-symbol.onnx --fp16 --sparsity=disable --workspace=8192 --verbose [05/21/2021-05:46:52] [I] === Model Options === [05/21/2021-05:46:52] [I] Format: ONNX [05/21/2021-05:46:52] [I] Model: resnet50-original-symbol.onnx [05/21/2021-05:46:52] [I] Output: [05/21/2021-05:46:52] [I] === Build Options === [05/21/2021-05:46:52] [I] Max batch: explicit [05/21/2021-05:46:52] [I] Workspace: 8192 MiB [05/21/2021-05:46:52] [I] minTiming: 1 [05/21/2021-05:46:52] [I] avgTiming: 8 [05/21/2021-05:46:52] [I] Precision: FP32+FP16 [05/21/2021-05:46:52] [I] Calibration: [05/21/2021-05:46:52] [I] Refit: Disabled [05/21/2021-05:46:52] [I] Sparsity: Disabled [05/21/2021-05:46:52] [I] Safe mode: Disabled [05/21/2021-05:46:52] [I] Enable serialization: Disabled [05/21/2021-05:46:52] [I] Save engine: [05/21/2021-05:46:52] [I] Load engine: [05/21/2021-05:46:52] [I] NVTX verbosity: 0 [05/21/2021-05:46:52] [I] Tactic sources: Using default tactic sources [05/21/2021-05:46:52] [I] timingCacheMode: local [05/21/2021-05:46:52] [I] timingCacheFile: [05/21/2021-05:46:52] [I] Input(s)s format: fp32:CHW [05/21/2021-05:46:52] [I] Output(s)s format: fp32:CHW [05/21/2021-05:46:52] [I] Input build shapes: model [05/21/2021-05:46:52] [I] Input calibration shapes: model [05/21/2021-05:46:52] [I] === System Options === [05/21/2021-05:46:52] [I] Device: 0 [05/21/2021-05:46:52] [I] DLACore: [05/21/2021-05:46:52] [I] Plugins: [05/21/2021-05:46:52] [I] === Inference Options === [05/21/2021-05:46:52] [I] Batch: Explicit [05/21/2021-05:46:52] [I] Input inference shapes: model [05/21/2021-05:46:52] [I] Iterations: 10 [05/21/2021-05:46:52] [I] Duration: 3s (+ 200ms warm up) [05/21/2021-05:46:52] [I] Sleep time: 0ms [05/21/2021-05:46:52] [I] Streams: 1 [05/21/2021-05:46:52] [I] ExposeDMA: Disabled [05/21/2021-05:46:52] [I] Data transfers: Enabled [05/21/2021-05:46:52] [I] Spin-wait: Disabled [05/21/2021-05:46:52] [I] Multithreading: Disabled [05/21/2021-05:46:52] [I] CUDA Graph: Disabled [05/21/2021-05:46:52] [I] Separate profiling: Disabled [05/21/2021-05:46:52] [I] Time Deserialize: Disabled [05/21/2021-05:46:52] [I] Time Refit: Disabled [05/21/2021-05:46:52] [I] Skip inference: Disabled [05/21/2021-05:46:52] [I] Inputs: [05/21/2021-05:46:52] [I] === Reporting Options === [05/21/2021-05:46:52] [I] Verbose: Enabled [05/21/2021-05:46:52] [I] Averages: 10 inferences [05/21/2021-05:46:52] [I] Percentile: 99 [05/21/2021-05:46:52] [I] Dump refittable layers:Disabled [05/21/2021-05:46:52] [I] Dump output: Disabled [05/21/2021-05:46:52] [I] Profile: Disabled [05/21/2021-05:46:52] [I] Export timing to JSON file: [05/21/2021-05:46:52] [I] Export output to JSON file: [05/21/2021-05:46:52] [I] Export profile to JSON file: [05/21/2021-05:46:52] [I] [05/21/2021-05:46:52] [I] === Device Information === [05/21/2021-05:46:52] [I] Selected Device: GeForce RTX 3090 [05/21/2021-05:46:52] [I] Compute Capability: 8.6 [05/21/2021-05:46:52] [I] SMs: 82 [05/21/2021-05:46:52] [I] Compute Clock Rate: 1.755 GHz [05/21/2021-05:46:52] [I] Device Global Memory: 24268 MiB [05/21/2021-05:46:52] [I] Shared Memory per SM: 100 KiB [05/21/2021-05:46:52] [I] Memory Bus Width: 384 bits (ECC disabled) [05/21/2021-05:46:52] [I] Memory Clock Rate: 9.751 GHz [05/21/2021-05:46:52] [I] [05/21/2021-05:46:52] [I] TensorRT version: 8000 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [05/21/2021-05:46:52] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::Proposal version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::Split version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [05/21/2021-05:46:53] [I] [TRT] [MemUsageChange] Init CUDA: CPU +444, GPU +0, now: CPU 450, GPU 10788 (MiB) [05/21/2021-05:46:53] [I] [TRT] ---------------------------------------------------------------- [05/21/2021-05:46:53] [I] [TRT] Input filename: resnet50-original-symbol.onnx [05/21/2021-05:46:53] [I] [TRT] ONNX IR version: 0.0.3 [05/21/2021-05:46:53] [I] [TRT] Opset version: 8 [05/21/2021-05:46:53] [I] [TRT] Producer name: [05/21/2021-05:46:53] [I] [TRT] Producer version: [05/21/2021-05:46:53] [I] [TRT] Domain: [05/21/2021-05:46:53] [I] [TRT] Model version: 0 [05/21/2021-05:46:53] [I] [TRT] Doc string: [05/21/2021-05:46:53] [I] [TRT] ---------------------------------------------------------------- [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::Split version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [05/21/2021-05:46:53] [V] [TRT] Adding network input: data with dtype: float32, dimensions: (1, 3, 224, 224) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: data for ONNX tensor: data [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn_data_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn_data_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn_data_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn_data_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: conv0_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn0_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn0_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn0_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn0_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage1_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage2_unit4_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit4_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit5_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage3_unit6_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: stage4_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn1_beta [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Importing initializer: bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] Importing initializer: fc1_weight [05/21/2021-05:46:53] [V] [TRT] Importing initializer: fc1_bias [05/21/2021-05:46:53] [V] [TRT] Parsing node: cast0 [Cast] [05/21/2021-05:46:53] [V] [TRT] Searching for input: data [05/21/2021-05:46:53] [V] [TRT] cast0 [Cast] inputs: [data -> (1, 3, 224, 224)], [05/21/2021-05:46:53] [V] [TRT] Casting to type: float16 [05/21/2021-05:46:53] [W] [TRT] Tensor DataType is determined at build time for tensors not marked as input or output. [05/21/2021-05:46:53] [V] [TRT] Registering layer: cast0 for ONNX node: cast0 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: cast0 for ONNX tensor: cast0 [05/21/2021-05:46:53] [V] [TRT] cast0 [Cast] outputs: [cast0 -> (1, 3, 224, 224)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: bn_data [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: cast0 [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn_data_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn_data_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn_data_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn_data_moving_var [05/21/2021-05:46:53] [V] [TRT] bn_data [BatchNormalization] inputs: [cast0 -> (1, 3, 224, 224)], [bn_data_gamma -> (3)], [bn_data_beta -> (3)], [bn_data_moving_mean -> (3)], [bn_data_moving_var -> (3)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: bn_data for ONNX node: bn_data [05/21/2021-05:46:53] [V] [TRT] Registering tensor: bn_data for ONNX tensor: bn_data [05/21/2021-05:46:53] [V] [TRT] bn_data [BatchNormalization] outputs: [bn_data -> (1, 3, 224, 224)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: conv0 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn_data [05/21/2021-05:46:53] [V] [TRT] Searching for input: conv0_weight [05/21/2021-05:46:53] [V] [TRT] conv0 [Conv] inputs: [bn_data -> (1, 3, 224, 224)], [conv0_weight -> (64, 3, 7, 7)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 3, 224, 224) [05/21/2021-05:46:53] [V] [TRT] Registering layer: conv0 for ONNX node: conv0 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 112, 112) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: conv0 for ONNX tensor: conv0 [05/21/2021-05:46:53] [V] [TRT] conv0 [Conv] outputs: [conv0 -> (1, 64, 112, 112)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: bn0 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: conv0 [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn0_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn0_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn0_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn0_moving_var [05/21/2021-05:46:53] [V] [TRT] bn0 [BatchNormalization] inputs: [conv0 -> (1, 64, 112, 112)], [bn0_gamma -> (64)], [bn0_beta -> (64)], [bn0_moving_mean -> (64)], [bn0_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: bn0 for ONNX node: bn0 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: bn0 for ONNX tensor: bn0 [05/21/2021-05:46:53] [V] [TRT] bn0 [BatchNormalization] outputs: [bn0 -> (1, 64, 112, 112)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: relu0 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: bn0 [05/21/2021-05:46:53] [V] [TRT] relu0 [Relu] inputs: [bn0 -> (1, 64, 112, 112)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: relu0 for ONNX node: relu0 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: relu0 for ONNX tensor: relu0 [05/21/2021-05:46:53] [V] [TRT] relu0 [Relu] outputs: [relu0 -> (1, 64, 112, 112)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: pooling0 [MaxPool] [05/21/2021-05:46:53] [V] [TRT] Searching for input: relu0 [05/21/2021-05:46:53] [V] [TRT] pooling0 [MaxPool] inputs: [relu0 -> (1, 64, 112, 112)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: pooling0 for ONNX node: pooling0 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: pooling0 for ONNX tensor: pooling0 [05/21/2021-05:46:53] [V] [TRT] pooling0 [MaxPool] outputs: [pooling0 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: pooling0 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn1 [BatchNormalization] inputs: [pooling0 -> (1, 64, 56, 56)], [stage1_unit1_bn1_gamma -> (64)], [stage1_unit1_bn1_beta -> (64)], [stage1_unit1_bn1_moving_mean -> (64)], [stage1_unit1_bn1_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_bn1 for ONNX node: stage1_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_bn1 for ONNX tensor: stage1_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn1 [BatchNormalization] outputs: [stage1_unit1_bn1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu1 [Relu] inputs: [stage1_unit1_bn1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_relu1 for ONNX node: stage1_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_relu1 for ONNX tensor: stage1_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu1 [Relu] outputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv1 [Conv] inputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], [stage1_unit1_conv1_weight -> (64, 64, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_conv1 for ONNX node: stage1_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_conv1 for ONNX tensor: stage1_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv1 [Conv] outputs: [stage1_unit1_conv1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn2 [BatchNormalization] inputs: [stage1_unit1_conv1 -> (1, 64, 56, 56)], [stage1_unit1_bn2_gamma -> (64)], [stage1_unit1_bn2_beta -> (64)], [stage1_unit1_bn2_moving_mean -> (64)], [stage1_unit1_bn2_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_bn2 for ONNX node: stage1_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_bn2 for ONNX tensor: stage1_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn2 [BatchNormalization] outputs: [stage1_unit1_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu2 [Relu] inputs: [stage1_unit1_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_relu2 for ONNX node: stage1_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_relu2 for ONNX tensor: stage1_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu2 [Relu] outputs: [stage1_unit1_relu2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv2 [Conv] inputs: [stage1_unit1_relu2 -> (1, 64, 56, 56)], [stage1_unit1_conv2_weight -> (64, 64, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_conv2 for ONNX node: stage1_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_conv2 for ONNX tensor: stage1_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv2 [Conv] outputs: [stage1_unit1_conv2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn3 [BatchNormalization] inputs: [stage1_unit1_conv2 -> (1, 64, 56, 56)], [stage1_unit1_bn3_gamma -> (64)], [stage1_unit1_bn3_beta -> (64)], [stage1_unit1_bn3_moving_mean -> (64)], [stage1_unit1_bn3_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_bn3 for ONNX node: stage1_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_bn3 for ONNX tensor: stage1_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_bn3 [BatchNormalization] outputs: [stage1_unit1_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu3 [Relu] inputs: [stage1_unit1_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_relu3 for ONNX node: stage1_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_relu3 for ONNX tensor: stage1_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_relu3 [Relu] outputs: [stage1_unit1_relu3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv3 [Conv] inputs: [stage1_unit1_relu3 -> (1, 64, 56, 56)], [stage1_unit1_conv3_weight -> (256, 64, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_conv3 for ONNX node: stage1_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_conv3 for ONNX tensor: stage1_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_conv3 [Conv] outputs: [stage1_unit1_conv3 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit1_sc [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_sc [Conv] inputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], [stage1_unit1_sc_weight -> (256, 64, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit1_sc for ONNX node: stage1_unit1_sc [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit1_sc for ONNX tensor: stage1_unit1_sc [05/21/2021-05:46:53] [V] [TRT] stage1_unit1_sc [Conv] outputs: [stage1_unit1_sc -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus0 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit1_sc [05/21/2021-05:46:53] [V] [TRT] _plus0 [Add] inputs: [stage1_unit1_conv3 -> (1, 256, 56, 56)], [stage1_unit1_sc -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus0 for ONNX node: _plus0 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus0 for ONNX tensor: _plus0 [05/21/2021-05:46:53] [V] [TRT] _plus0 [Add] outputs: [_plus0 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus0 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn1 [BatchNormalization] inputs: [_plus0 -> (1, 256, 56, 56)], [stage1_unit2_bn1_gamma -> (256)], [stage1_unit2_bn1_beta -> (256)], [stage1_unit2_bn1_moving_mean -> (256)], [stage1_unit2_bn1_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_bn1 for ONNX node: stage1_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_bn1 for ONNX tensor: stage1_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn1 [BatchNormalization] outputs: [stage1_unit2_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu1 [Relu] inputs: [stage1_unit2_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_relu1 for ONNX node: stage1_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_relu1 for ONNX tensor: stage1_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu1 [Relu] outputs: [stage1_unit2_relu1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv1 [Conv] inputs: [stage1_unit2_relu1 -> (1, 256, 56, 56)], [stage1_unit2_conv1_weight -> (64, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_conv1 for ONNX node: stage1_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_conv1 for ONNX tensor: stage1_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv1 [Conv] outputs: [stage1_unit2_conv1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn2 [BatchNormalization] inputs: [stage1_unit2_conv1 -> (1, 64, 56, 56)], [stage1_unit2_bn2_gamma -> (64)], [stage1_unit2_bn2_beta -> (64)], [stage1_unit2_bn2_moving_mean -> (64)], [stage1_unit2_bn2_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_bn2 for ONNX node: stage1_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_bn2 for ONNX tensor: stage1_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn2 [BatchNormalization] outputs: [stage1_unit2_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu2 [Relu] inputs: [stage1_unit2_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_relu2 for ONNX node: stage1_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_relu2 for ONNX tensor: stage1_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu2 [Relu] outputs: [stage1_unit2_relu2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv2 [Conv] inputs: [stage1_unit2_relu2 -> (1, 64, 56, 56)], [stage1_unit2_conv2_weight -> (64, 64, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_conv2 for ONNX node: stage1_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_conv2 for ONNX tensor: stage1_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv2 [Conv] outputs: [stage1_unit2_conv2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn3 [BatchNormalization] inputs: [stage1_unit2_conv2 -> (1, 64, 56, 56)], [stage1_unit2_bn3_gamma -> (64)], [stage1_unit2_bn3_beta -> (64)], [stage1_unit2_bn3_moving_mean -> (64)], [stage1_unit2_bn3_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_bn3 for ONNX node: stage1_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_bn3 for ONNX tensor: stage1_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_bn3 [BatchNormalization] outputs: [stage1_unit2_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu3 [Relu] inputs: [stage1_unit2_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_relu3 for ONNX node: stage1_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_relu3 for ONNX tensor: stage1_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_relu3 [Relu] outputs: [stage1_unit2_relu3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit2_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv3 [Conv] inputs: [stage1_unit2_relu3 -> (1, 64, 56, 56)], [stage1_unit2_conv3_weight -> (256, 64, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit2_conv3 for ONNX node: stage1_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit2_conv3 for ONNX tensor: stage1_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit2_conv3 [Conv] outputs: [stage1_unit2_conv3 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus1 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus0 [05/21/2021-05:46:53] [V] [TRT] _plus1 [Add] inputs: [stage1_unit2_conv3 -> (1, 256, 56, 56)], [_plus0 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus1 for ONNX node: _plus1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus1 for ONNX tensor: _plus1 [05/21/2021-05:46:53] [V] [TRT] _plus1 [Add] outputs: [_plus1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn1 [BatchNormalization] inputs: [_plus1 -> (1, 256, 56, 56)], [stage1_unit3_bn1_gamma -> (256)], [stage1_unit3_bn1_beta -> (256)], [stage1_unit3_bn1_moving_mean -> (256)], [stage1_unit3_bn1_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_bn1 for ONNX node: stage1_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_bn1 for ONNX tensor: stage1_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn1 [BatchNormalization] outputs: [stage1_unit3_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu1 [Relu] inputs: [stage1_unit3_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_relu1 for ONNX node: stage1_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_relu1 for ONNX tensor: stage1_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu1 [Relu] outputs: [stage1_unit3_relu1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv1 [Conv] inputs: [stage1_unit3_relu1 -> (1, 256, 56, 56)], [stage1_unit3_conv1_weight -> (64, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_conv1 for ONNX node: stage1_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_conv1 for ONNX tensor: stage1_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv1 [Conv] outputs: [stage1_unit3_conv1 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn2 [BatchNormalization] inputs: [stage1_unit3_conv1 -> (1, 64, 56, 56)], [stage1_unit3_bn2_gamma -> (64)], [stage1_unit3_bn2_beta -> (64)], [stage1_unit3_bn2_moving_mean -> (64)], [stage1_unit3_bn2_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_bn2 for ONNX node: stage1_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_bn2 for ONNX tensor: stage1_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn2 [BatchNormalization] outputs: [stage1_unit3_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu2 [Relu] inputs: [stage1_unit3_bn2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_relu2 for ONNX node: stage1_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_relu2 for ONNX tensor: stage1_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu2 [Relu] outputs: [stage1_unit3_relu2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv2 [Conv] inputs: [stage1_unit3_relu2 -> (1, 64, 56, 56)], [stage1_unit3_conv2_weight -> (64, 64, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_conv2 for ONNX node: stage1_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_conv2 for ONNX tensor: stage1_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv2 [Conv] outputs: [stage1_unit3_conv2 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn3 [BatchNormalization] inputs: [stage1_unit3_conv2 -> (1, 64, 56, 56)], [stage1_unit3_bn3_gamma -> (64)], [stage1_unit3_bn3_beta -> (64)], [stage1_unit3_bn3_moving_mean -> (64)], [stage1_unit3_bn3_moving_var -> (64)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_bn3 for ONNX node: stage1_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_bn3 for ONNX tensor: stage1_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_bn3 [BatchNormalization] outputs: [stage1_unit3_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu3 [Relu] inputs: [stage1_unit3_bn3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_relu3 for ONNX node: stage1_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_relu3 for ONNX tensor: stage1_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_relu3 [Relu] outputs: [stage1_unit3_relu3 -> (1, 64, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage1_unit3_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv3 [Conv] inputs: [stage1_unit3_relu3 -> (1, 64, 56, 56)], [stage1_unit3_conv3_weight -> (256, 64, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage1_unit3_conv3 for ONNX node: stage1_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage1_unit3_conv3 for ONNX tensor: stage1_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] stage1_unit3_conv3 [Conv] outputs: [stage1_unit3_conv3 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus2 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage1_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus1 [05/21/2021-05:46:53] [V] [TRT] _plus2 [Add] inputs: [stage1_unit3_conv3 -> (1, 256, 56, 56)], [_plus1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus2 for ONNX node: _plus2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus2 for ONNX tensor: _plus2 [05/21/2021-05:46:53] [V] [TRT] _plus2 [Add] outputs: [_plus2 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn1 [BatchNormalization] inputs: [_plus2 -> (1, 256, 56, 56)], [stage2_unit1_bn1_gamma -> (256)], [stage2_unit1_bn1_beta -> (256)], [stage2_unit1_bn1_moving_mean -> (256)], [stage2_unit1_bn1_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_bn1 for ONNX node: stage2_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_bn1 for ONNX tensor: stage2_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn1 [BatchNormalization] outputs: [stage2_unit1_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu1 [Relu] inputs: [stage2_unit1_bn1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_relu1 for ONNX node: stage2_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_relu1 for ONNX tensor: stage2_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu1 [Relu] outputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv1 [Conv] inputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], [stage2_unit1_conv1_weight -> (128, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_conv1 for ONNX node: stage2_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_conv1 for ONNX tensor: stage2_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv1 [Conv] outputs: [stage2_unit1_conv1 -> (1, 128, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn2 [BatchNormalization] inputs: [stage2_unit1_conv1 -> (1, 128, 56, 56)], [stage2_unit1_bn2_gamma -> (128)], [stage2_unit1_bn2_beta -> (128)], [stage2_unit1_bn2_moving_mean -> (128)], [stage2_unit1_bn2_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_bn2 for ONNX node: stage2_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_bn2 for ONNX tensor: stage2_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn2 [BatchNormalization] outputs: [stage2_unit1_bn2 -> (1, 128, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu2 [Relu] inputs: [stage2_unit1_bn2 -> (1, 128, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_relu2 for ONNX node: stage2_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_relu2 for ONNX tensor: stage2_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu2 [Relu] outputs: [stage2_unit1_relu2 -> (1, 128, 56, 56)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv2 [Conv] inputs: [stage2_unit1_relu2 -> (1, 128, 56, 56)], [stage2_unit1_conv2_weight -> (128, 128, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_conv2 for ONNX node: stage2_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_conv2 for ONNX tensor: stage2_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv2 [Conv] outputs: [stage2_unit1_conv2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn3 [BatchNormalization] inputs: [stage2_unit1_conv2 -> (1, 128, 28, 28)], [stage2_unit1_bn3_gamma -> (128)], [stage2_unit1_bn3_beta -> (128)], [stage2_unit1_bn3_moving_mean -> (128)], [stage2_unit1_bn3_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_bn3 for ONNX node: stage2_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_bn3 for ONNX tensor: stage2_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_bn3 [BatchNormalization] outputs: [stage2_unit1_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu3 [Relu] inputs: [stage2_unit1_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_relu3 for ONNX node: stage2_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_relu3 for ONNX tensor: stage2_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_relu3 [Relu] outputs: [stage2_unit1_relu3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv3 [Conv] inputs: [stage2_unit1_relu3 -> (1, 128, 28, 28)], [stage2_unit1_conv3_weight -> (512, 128, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_conv3 for ONNX node: stage2_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_conv3 for ONNX tensor: stage2_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_conv3 [Conv] outputs: [stage2_unit1_conv3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit1_sc [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_sc [Conv] inputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], [stage2_unit1_sc_weight -> (512, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit1_sc for ONNX node: stage2_unit1_sc [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit1_sc for ONNX tensor: stage2_unit1_sc [05/21/2021-05:46:53] [V] [TRT] stage2_unit1_sc [Conv] outputs: [stage2_unit1_sc -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus3 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit1_sc [05/21/2021-05:46:53] [V] [TRT] _plus3 [Add] inputs: [stage2_unit1_conv3 -> (1, 512, 28, 28)], [stage2_unit1_sc -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus3 for ONNX node: _plus3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus3 for ONNX tensor: _plus3 [05/21/2021-05:46:53] [V] [TRT] _plus3 [Add] outputs: [_plus3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn1 [BatchNormalization] inputs: [_plus3 -> (1, 512, 28, 28)], [stage2_unit2_bn1_gamma -> (512)], [stage2_unit2_bn1_beta -> (512)], [stage2_unit2_bn1_moving_mean -> (512)], [stage2_unit2_bn1_moving_var -> (512)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_bn1 for ONNX node: stage2_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_bn1 for ONNX tensor: stage2_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn1 [BatchNormalization] outputs: [stage2_unit2_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu1 [Relu] inputs: [stage2_unit2_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_relu1 for ONNX node: stage2_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_relu1 for ONNX tensor: stage2_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu1 [Relu] outputs: [stage2_unit2_relu1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv1 [Conv] inputs: [stage2_unit2_relu1 -> (1, 512, 28, 28)], [stage2_unit2_conv1_weight -> (128, 512, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_conv1 for ONNX node: stage2_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_conv1 for ONNX tensor: stage2_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv1 [Conv] outputs: [stage2_unit2_conv1 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn2 [BatchNormalization] inputs: [stage2_unit2_conv1 -> (1, 128, 28, 28)], [stage2_unit2_bn2_gamma -> (128)], [stage2_unit2_bn2_beta -> (128)], [stage2_unit2_bn2_moving_mean -> (128)], [stage2_unit2_bn2_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_bn2 for ONNX node: stage2_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_bn2 for ONNX tensor: stage2_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn2 [BatchNormalization] outputs: [stage2_unit2_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu2 [Relu] inputs: [stage2_unit2_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_relu2 for ONNX node: stage2_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_relu2 for ONNX tensor: stage2_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu2 [Relu] outputs: [stage2_unit2_relu2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv2 [Conv] inputs: [stage2_unit2_relu2 -> (1, 128, 28, 28)], [stage2_unit2_conv2_weight -> (128, 128, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_conv2 for ONNX node: stage2_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_conv2 for ONNX tensor: stage2_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv2 [Conv] outputs: [stage2_unit2_conv2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn3 [BatchNormalization] inputs: [stage2_unit2_conv2 -> (1, 128, 28, 28)], [stage2_unit2_bn3_gamma -> (128)], [stage2_unit2_bn3_beta -> (128)], [stage2_unit2_bn3_moving_mean -> (128)], [stage2_unit2_bn3_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_bn3 for ONNX node: stage2_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_bn3 for ONNX tensor: stage2_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_bn3 [BatchNormalization] outputs: [stage2_unit2_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu3 [Relu] inputs: [stage2_unit2_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_relu3 for ONNX node: stage2_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_relu3 for ONNX tensor: stage2_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_relu3 [Relu] outputs: [stage2_unit2_relu3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit2_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv3 [Conv] inputs: [stage2_unit2_relu3 -> (1, 128, 28, 28)], [stage2_unit2_conv3_weight -> (512, 128, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit2_conv3 for ONNX node: stage2_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit2_conv3 for ONNX tensor: stage2_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit2_conv3 [Conv] outputs: [stage2_unit2_conv3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus4 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus3 [05/21/2021-05:46:53] [V] [TRT] _plus4 [Add] inputs: [stage2_unit2_conv3 -> (1, 512, 28, 28)], [_plus3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus4 for ONNX node: _plus4 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus4 for ONNX tensor: _plus4 [05/21/2021-05:46:53] [V] [TRT] _plus4 [Add] outputs: [_plus4 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus4 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn1 [BatchNormalization] inputs: [_plus4 -> (1, 512, 28, 28)], [stage2_unit3_bn1_gamma -> (512)], [stage2_unit3_bn1_beta -> (512)], [stage2_unit3_bn1_moving_mean -> (512)], [stage2_unit3_bn1_moving_var -> (512)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_bn1 for ONNX node: stage2_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_bn1 for ONNX tensor: stage2_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn1 [BatchNormalization] outputs: [stage2_unit3_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu1 [Relu] inputs: [stage2_unit3_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_relu1 for ONNX node: stage2_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_relu1 for ONNX tensor: stage2_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu1 [Relu] outputs: [stage2_unit3_relu1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv1 [Conv] inputs: [stage2_unit3_relu1 -> (1, 512, 28, 28)], [stage2_unit3_conv1_weight -> (128, 512, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_conv1 for ONNX node: stage2_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_conv1 for ONNX tensor: stage2_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv1 [Conv] outputs: [stage2_unit3_conv1 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn2 [BatchNormalization] inputs: [stage2_unit3_conv1 -> (1, 128, 28, 28)], [stage2_unit3_bn2_gamma -> (128)], [stage2_unit3_bn2_beta -> (128)], [stage2_unit3_bn2_moving_mean -> (128)], [stage2_unit3_bn2_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_bn2 for ONNX node: stage2_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_bn2 for ONNX tensor: stage2_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn2 [BatchNormalization] outputs: [stage2_unit3_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu2 [Relu] inputs: [stage2_unit3_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_relu2 for ONNX node: stage2_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_relu2 for ONNX tensor: stage2_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu2 [Relu] outputs: [stage2_unit3_relu2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv2 [Conv] inputs: [stage2_unit3_relu2 -> (1, 128, 28, 28)], [stage2_unit3_conv2_weight -> (128, 128, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_conv2 for ONNX node: stage2_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_conv2 for ONNX tensor: stage2_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv2 [Conv] outputs: [stage2_unit3_conv2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn3 [BatchNormalization] inputs: [stage2_unit3_conv2 -> (1, 128, 28, 28)], [stage2_unit3_bn3_gamma -> (128)], [stage2_unit3_bn3_beta -> (128)], [stage2_unit3_bn3_moving_mean -> (128)], [stage2_unit3_bn3_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_bn3 for ONNX node: stage2_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_bn3 for ONNX tensor: stage2_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_bn3 [BatchNormalization] outputs: [stage2_unit3_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu3 [Relu] inputs: [stage2_unit3_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_relu3 for ONNX node: stage2_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_relu3 for ONNX tensor: stage2_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_relu3 [Relu] outputs: [stage2_unit3_relu3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit3_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv3 [Conv] inputs: [stage2_unit3_relu3 -> (1, 128, 28, 28)], [stage2_unit3_conv3_weight -> (512, 128, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit3_conv3 for ONNX node: stage2_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit3_conv3 for ONNX tensor: stage2_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit3_conv3 [Conv] outputs: [stage2_unit3_conv3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus5 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit3_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus4 [05/21/2021-05:46:53] [V] [TRT] _plus5 [Add] inputs: [stage2_unit3_conv3 -> (1, 512, 28, 28)], [_plus4 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus5 for ONNX node: _plus5 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus5 for ONNX tensor: _plus5 [05/21/2021-05:46:53] [V] [TRT] _plus5 [Add] outputs: [_plus5 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus5 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn1 [BatchNormalization] inputs: [_plus5 -> (1, 512, 28, 28)], [stage2_unit4_bn1_gamma -> (512)], [stage2_unit4_bn1_beta -> (512)], [stage2_unit4_bn1_moving_mean -> (512)], [stage2_unit4_bn1_moving_var -> (512)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_bn1 for ONNX node: stage2_unit4_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_bn1 for ONNX tensor: stage2_unit4_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn1 [BatchNormalization] outputs: [stage2_unit4_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu1 [Relu] inputs: [stage2_unit4_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_relu1 for ONNX node: stage2_unit4_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_relu1 for ONNX tensor: stage2_unit4_relu1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu1 [Relu] outputs: [stage2_unit4_relu1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv1 [Conv] inputs: [stage2_unit4_relu1 -> (1, 512, 28, 28)], [stage2_unit4_conv1_weight -> (128, 512, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_conv1 for ONNX node: stage2_unit4_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_conv1 for ONNX tensor: stage2_unit4_conv1 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv1 [Conv] outputs: [stage2_unit4_conv1 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn2 [BatchNormalization] inputs: [stage2_unit4_conv1 -> (1, 128, 28, 28)], [stage2_unit4_bn2_gamma -> (128)], [stage2_unit4_bn2_beta -> (128)], [stage2_unit4_bn2_moving_mean -> (128)], [stage2_unit4_bn2_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_bn2 for ONNX node: stage2_unit4_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_bn2 for ONNX tensor: stage2_unit4_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn2 [BatchNormalization] outputs: [stage2_unit4_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu2 [Relu] inputs: [stage2_unit4_bn2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_relu2 for ONNX node: stage2_unit4_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_relu2 for ONNX tensor: stage2_unit4_relu2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu2 [Relu] outputs: [stage2_unit4_relu2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv2 [Conv] inputs: [stage2_unit4_relu2 -> (1, 128, 28, 28)], [stage2_unit4_conv2_weight -> (128, 128, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_conv2 for ONNX node: stage2_unit4_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_conv2 for ONNX tensor: stage2_unit4_conv2 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv2 [Conv] outputs: [stage2_unit4_conv2 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn3 [BatchNormalization] inputs: [stage2_unit4_conv2 -> (1, 128, 28, 28)], [stage2_unit4_bn3_gamma -> (128)], [stage2_unit4_bn3_beta -> (128)], [stage2_unit4_bn3_moving_mean -> (128)], [stage2_unit4_bn3_moving_var -> (128)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_bn3 for ONNX node: stage2_unit4_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_bn3 for ONNX tensor: stage2_unit4_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_bn3 [BatchNormalization] outputs: [stage2_unit4_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_bn3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu3 [Relu] inputs: [stage2_unit4_bn3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_relu3 for ONNX node: stage2_unit4_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_relu3 for ONNX tensor: stage2_unit4_relu3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_relu3 [Relu] outputs: [stage2_unit4_relu3 -> (1, 128, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage2_unit4_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv3 [Conv] inputs: [stage2_unit4_relu3 -> (1, 128, 28, 28)], [stage2_unit4_conv3_weight -> (512, 128, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage2_unit4_conv3 for ONNX node: stage2_unit4_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage2_unit4_conv3 for ONNX tensor: stage2_unit4_conv3 [05/21/2021-05:46:53] [V] [TRT] stage2_unit4_conv3 [Conv] outputs: [stage2_unit4_conv3 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus6 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage2_unit4_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus5 [05/21/2021-05:46:53] [V] [TRT] _plus6 [Add] inputs: [stage2_unit4_conv3 -> (1, 512, 28, 28)], [_plus5 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus6 for ONNX node: _plus6 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus6 for ONNX tensor: _plus6 [05/21/2021-05:46:53] [V] [TRT] _plus6 [Add] outputs: [_plus6 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus6 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn1 [BatchNormalization] inputs: [_plus6 -> (1, 512, 28, 28)], [stage3_unit1_bn1_gamma -> (512)], [stage3_unit1_bn1_beta -> (512)], [stage3_unit1_bn1_moving_mean -> (512)], [stage3_unit1_bn1_moving_var -> (512)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_bn1 for ONNX node: stage3_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_bn1 for ONNX tensor: stage3_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn1 [BatchNormalization] outputs: [stage3_unit1_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu1 [Relu] inputs: [stage3_unit1_bn1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_relu1 for ONNX node: stage3_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_relu1 for ONNX tensor: stage3_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu1 [Relu] outputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv1 [Conv] inputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], [stage3_unit1_conv1_weight -> (256, 512, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_conv1 for ONNX node: stage3_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_conv1 for ONNX tensor: stage3_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv1 [Conv] outputs: [stage3_unit1_conv1 -> (1, 256, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn2 [BatchNormalization] inputs: [stage3_unit1_conv1 -> (1, 256, 28, 28)], [stage3_unit1_bn2_gamma -> (256)], [stage3_unit1_bn2_beta -> (256)], [stage3_unit1_bn2_moving_mean -> (256)], [stage3_unit1_bn2_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_bn2 for ONNX node: stage3_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_bn2 for ONNX tensor: stage3_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn2 [BatchNormalization] outputs: [stage3_unit1_bn2 -> (1, 256, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu2 [Relu] inputs: [stage3_unit1_bn2 -> (1, 256, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_relu2 for ONNX node: stage3_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_relu2 for ONNX tensor: stage3_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu2 [Relu] outputs: [stage3_unit1_relu2 -> (1, 256, 28, 28)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv2 [Conv] inputs: [stage3_unit1_relu2 -> (1, 256, 28, 28)], [stage3_unit1_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_conv2 for ONNX node: stage3_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_conv2 for ONNX tensor: stage3_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv2 [Conv] outputs: [stage3_unit1_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn3 [BatchNormalization] inputs: [stage3_unit1_conv2 -> (1, 256, 14, 14)], [stage3_unit1_bn3_gamma -> (256)], [stage3_unit1_bn3_beta -> (256)], [stage3_unit1_bn3_moving_mean -> (256)], [stage3_unit1_bn3_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_bn3 for ONNX node: stage3_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_bn3 for ONNX tensor: stage3_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_bn3 [BatchNormalization] outputs: [stage3_unit1_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_bn3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu3 [Relu] inputs: [stage3_unit1_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_relu3 for ONNX node: stage3_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_relu3 for ONNX tensor: stage3_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_relu3 [Relu] outputs: [stage3_unit1_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv3 [Conv] inputs: [stage3_unit1_relu3 -> (1, 256, 14, 14)], [stage3_unit1_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_conv3 for ONNX node: stage3_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_conv3 for ONNX tensor: stage3_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_conv3 [Conv] outputs: [stage3_unit1_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit1_sc [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_sc_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_sc [Conv] inputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], [stage3_unit1_sc_weight -> (1024, 512, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit1_sc for ONNX node: stage3_unit1_sc [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit1_sc for ONNX tensor: stage3_unit1_sc [05/21/2021-05:46:53] [V] [TRT] stage3_unit1_sc [Conv] outputs: [stage3_unit1_sc -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus7 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit1_sc [05/21/2021-05:46:53] [V] [TRT] _plus7 [Add] inputs: [stage3_unit1_conv3 -> (1, 1024, 14, 14)], [stage3_unit1_sc -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: _plus7 for ONNX node: _plus7 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: _plus7 for ONNX tensor: _plus7 [05/21/2021-05:46:53] [V] [TRT] _plus7 [Add] outputs: [_plus7 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_bn1 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus7 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn1_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn1_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn1_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn1_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn1 [BatchNormalization] inputs: [_plus7 -> (1, 1024, 14, 14)], [stage3_unit2_bn1_gamma -> (1024)], [stage3_unit2_bn1_beta -> (1024)], [stage3_unit2_bn1_moving_mean -> (1024)], [stage3_unit2_bn1_moving_var -> (1024)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_bn1 for ONNX node: stage3_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_bn1 for ONNX tensor: stage3_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn1 [BatchNormalization] outputs: [stage3_unit2_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_relu1 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu1 [Relu] inputs: [stage3_unit2_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_relu1 for ONNX node: stage3_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_relu1 for ONNX tensor: stage3_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu1 [Relu] outputs: [stage3_unit2_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_conv1 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_relu1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv1_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv1 [Conv] inputs: [stage3_unit2_relu1 -> (1, 1024, 14, 14)], [stage3_unit2_conv1_weight -> (256, 1024, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_conv1 for ONNX node: stage3_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_conv1 for ONNX tensor: stage3_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv1 [Conv] outputs: [stage3_unit2_conv1 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_bn2 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv1 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn2_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn2_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn2_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn2_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn2 [BatchNormalization] inputs: [stage3_unit2_conv1 -> (1, 256, 14, 14)], [stage3_unit2_bn2_gamma -> (256)], [stage3_unit2_bn2_beta -> (256)], [stage3_unit2_bn2_moving_mean -> (256)], [stage3_unit2_bn2_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_bn2 for ONNX node: stage3_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_bn2 for ONNX tensor: stage3_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn2 [BatchNormalization] outputs: [stage3_unit2_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_relu2 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu2 [Relu] inputs: [stage3_unit2_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_relu2 for ONNX node: stage3_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_relu2 for ONNX tensor: stage3_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu2 [Relu] outputs: [stage3_unit2_relu2 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_conv2 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_relu2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv2_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv2 [Conv] inputs: [stage3_unit2_relu2 -> (1, 256, 14, 14)], [stage3_unit2_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_conv2 for ONNX node: stage3_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_conv2 for ONNX tensor: stage3_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv2 [Conv] outputs: [stage3_unit2_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_bn3 [BatchNormalization] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv2 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn3_gamma [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn3_beta [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn3_moving_mean [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn3_moving_var [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn3 [BatchNormalization] inputs: [stage3_unit2_conv2 -> (1, 256, 14, 14)], [stage3_unit2_bn3_gamma -> (256)], [stage3_unit2_bn3_beta -> (256)], [stage3_unit2_bn3_moving_mean -> (256)], [stage3_unit2_bn3_moving_var -> (256)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_bn3 for ONNX node: stage3_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_bn3 for ONNX tensor: stage3_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_bn3 [BatchNormalization] outputs: [stage3_unit2_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_relu3 [Relu] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_bn3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu3 [Relu] inputs: [stage3_unit2_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_relu3 for ONNX node: stage3_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_relu3 for ONNX tensor: stage3_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_relu3 [Relu] outputs: [stage3_unit2_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: stage3_unit2_conv3 [Conv] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_relu3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv3_weight [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv3 [Conv] inputs: [stage3_unit2_relu3 -> (1, 256, 14, 14)], [stage3_unit2_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:53] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering layer: stage3_unit2_conv3 for ONNX node: stage3_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:53] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:53] [V] [TRT] Registering tensor: stage3_unit2_conv3 for ONNX tensor: stage3_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] stage3_unit2_conv3 [Conv] outputs: [stage3_unit2_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:53] [V] [TRT] Parsing node: _plus8 [Add] [05/21/2021-05:46:53] [V] [TRT] Searching for input: stage3_unit2_conv3 [05/21/2021-05:46:53] [V] [TRT] Searching for input: _plus7 [05/21/2021-05:46:53] [V] [TRT] _plus8 [Add] inputs: [stage3_unit2_conv3 -> (1, 1024, 14, 14)], [_plus7 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus8 for ONNX node: _plus8 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus8 for ONNX tensor: _plus8 [05/21/2021-05:46:54] [V] [TRT] _plus8 [Add] outputs: [_plus8 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus8 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn1 [BatchNormalization] inputs: [_plus8 -> (1, 1024, 14, 14)], [stage3_unit3_bn1_gamma -> (1024)], [stage3_unit3_bn1_beta -> (1024)], [stage3_unit3_bn1_moving_mean -> (1024)], [stage3_unit3_bn1_moving_var -> (1024)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_bn1 for ONNX node: stage3_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_bn1 for ONNX tensor: stage3_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn1 [BatchNormalization] outputs: [stage3_unit3_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu1 [Relu] inputs: [stage3_unit3_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_relu1 for ONNX node: stage3_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_relu1 for ONNX tensor: stage3_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu1 [Relu] outputs: [stage3_unit3_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv1 [Conv] inputs: [stage3_unit3_relu1 -> (1, 1024, 14, 14)], [stage3_unit3_conv1_weight -> (256, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_conv1 for ONNX node: stage3_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_conv1 for ONNX tensor: stage3_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv1 [Conv] outputs: [stage3_unit3_conv1 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn2 [BatchNormalization] inputs: [stage3_unit3_conv1 -> (1, 256, 14, 14)], [stage3_unit3_bn2_gamma -> (256)], [stage3_unit3_bn2_beta -> (256)], [stage3_unit3_bn2_moving_mean -> (256)], [stage3_unit3_bn2_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_bn2 for ONNX node: stage3_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_bn2 for ONNX tensor: stage3_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn2 [BatchNormalization] outputs: [stage3_unit3_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu2 [Relu] inputs: [stage3_unit3_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_relu2 for ONNX node: stage3_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_relu2 for ONNX tensor: stage3_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu2 [Relu] outputs: [stage3_unit3_relu2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv2 [Conv] inputs: [stage3_unit3_relu2 -> (1, 256, 14, 14)], [stage3_unit3_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_conv2 for ONNX node: stage3_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_conv2 for ONNX tensor: stage3_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv2 [Conv] outputs: [stage3_unit3_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn3 [BatchNormalization] inputs: [stage3_unit3_conv2 -> (1, 256, 14, 14)], [stage3_unit3_bn3_gamma -> (256)], [stage3_unit3_bn3_beta -> (256)], [stage3_unit3_bn3_moving_mean -> (256)], [stage3_unit3_bn3_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_bn3 for ONNX node: stage3_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_bn3 for ONNX tensor: stage3_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_bn3 [BatchNormalization] outputs: [stage3_unit3_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu3 [Relu] inputs: [stage3_unit3_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_relu3 for ONNX node: stage3_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_relu3 for ONNX tensor: stage3_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_relu3 [Relu] outputs: [stage3_unit3_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit3_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv3 [Conv] inputs: [stage3_unit3_relu3 -> (1, 256, 14, 14)], [stage3_unit3_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit3_conv3 for ONNX node: stage3_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit3_conv3 for ONNX tensor: stage3_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit3_conv3 [Conv] outputs: [stage3_unit3_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus9 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus8 [05/21/2021-05:46:54] [V] [TRT] _plus9 [Add] inputs: [stage3_unit3_conv3 -> (1, 1024, 14, 14)], [_plus8 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus9 for ONNX node: _plus9 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus9 for ONNX tensor: _plus9 [05/21/2021-05:46:54] [V] [TRT] _plus9 [Add] outputs: [_plus9 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus9 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn1 [BatchNormalization] inputs: [_plus9 -> (1, 1024, 14, 14)], [stage3_unit4_bn1_gamma -> (1024)], [stage3_unit4_bn1_beta -> (1024)], [stage3_unit4_bn1_moving_mean -> (1024)], [stage3_unit4_bn1_moving_var -> (1024)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_bn1 for ONNX node: stage3_unit4_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_bn1 for ONNX tensor: stage3_unit4_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn1 [BatchNormalization] outputs: [stage3_unit4_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu1 [Relu] inputs: [stage3_unit4_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_relu1 for ONNX node: stage3_unit4_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_relu1 for ONNX tensor: stage3_unit4_relu1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu1 [Relu] outputs: [stage3_unit4_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv1 [Conv] inputs: [stage3_unit4_relu1 -> (1, 1024, 14, 14)], [stage3_unit4_conv1_weight -> (256, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_conv1 for ONNX node: stage3_unit4_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_conv1 for ONNX tensor: stage3_unit4_conv1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv1 [Conv] outputs: [stage3_unit4_conv1 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn2 [BatchNormalization] inputs: [stage3_unit4_conv1 -> (1, 256, 14, 14)], [stage3_unit4_bn2_gamma -> (256)], [stage3_unit4_bn2_beta -> (256)], [stage3_unit4_bn2_moving_mean -> (256)], [stage3_unit4_bn2_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_bn2 for ONNX node: stage3_unit4_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_bn2 for ONNX tensor: stage3_unit4_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn2 [BatchNormalization] outputs: [stage3_unit4_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu2 [Relu] inputs: [stage3_unit4_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_relu2 for ONNX node: stage3_unit4_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_relu2 for ONNX tensor: stage3_unit4_relu2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu2 [Relu] outputs: [stage3_unit4_relu2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv2 [Conv] inputs: [stage3_unit4_relu2 -> (1, 256, 14, 14)], [stage3_unit4_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_conv2 for ONNX node: stage3_unit4_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_conv2 for ONNX tensor: stage3_unit4_conv2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv2 [Conv] outputs: [stage3_unit4_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn3 [BatchNormalization] inputs: [stage3_unit4_conv2 -> (1, 256, 14, 14)], [stage3_unit4_bn3_gamma -> (256)], [stage3_unit4_bn3_beta -> (256)], [stage3_unit4_bn3_moving_mean -> (256)], [stage3_unit4_bn3_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_bn3 for ONNX node: stage3_unit4_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_bn3 for ONNX tensor: stage3_unit4_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_bn3 [BatchNormalization] outputs: [stage3_unit4_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu3 [Relu] inputs: [stage3_unit4_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_relu3 for ONNX node: stage3_unit4_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_relu3 for ONNX tensor: stage3_unit4_relu3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_relu3 [Relu] outputs: [stage3_unit4_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit4_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv3 [Conv] inputs: [stage3_unit4_relu3 -> (1, 256, 14, 14)], [stage3_unit4_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit4_conv3 for ONNX node: stage3_unit4_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit4_conv3 for ONNX tensor: stage3_unit4_conv3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit4_conv3 [Conv] outputs: [stage3_unit4_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus10 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit4_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus9 [05/21/2021-05:46:54] [V] [TRT] _plus10 [Add] inputs: [stage3_unit4_conv3 -> (1, 1024, 14, 14)], [_plus9 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus10 for ONNX node: _plus10 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus10 for ONNX tensor: _plus10 [05/21/2021-05:46:54] [V] [TRT] _plus10 [Add] outputs: [_plus10 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus10 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn1 [BatchNormalization] inputs: [_plus10 -> (1, 1024, 14, 14)], [stage3_unit5_bn1_gamma -> (1024)], [stage3_unit5_bn1_beta -> (1024)], [stage3_unit5_bn1_moving_mean -> (1024)], [stage3_unit5_bn1_moving_var -> (1024)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_bn1 for ONNX node: stage3_unit5_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_bn1 for ONNX tensor: stage3_unit5_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn1 [BatchNormalization] outputs: [stage3_unit5_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu1 [Relu] inputs: [stage3_unit5_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_relu1 for ONNX node: stage3_unit5_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_relu1 for ONNX tensor: stage3_unit5_relu1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu1 [Relu] outputs: [stage3_unit5_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv1 [Conv] inputs: [stage3_unit5_relu1 -> (1, 1024, 14, 14)], [stage3_unit5_conv1_weight -> (256, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_conv1 for ONNX node: stage3_unit5_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_conv1 for ONNX tensor: stage3_unit5_conv1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv1 [Conv] outputs: [stage3_unit5_conv1 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn2 [BatchNormalization] inputs: [stage3_unit5_conv1 -> (1, 256, 14, 14)], [stage3_unit5_bn2_gamma -> (256)], [stage3_unit5_bn2_beta -> (256)], [stage3_unit5_bn2_moving_mean -> (256)], [stage3_unit5_bn2_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_bn2 for ONNX node: stage3_unit5_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_bn2 for ONNX tensor: stage3_unit5_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn2 [BatchNormalization] outputs: [stage3_unit5_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu2 [Relu] inputs: [stage3_unit5_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_relu2 for ONNX node: stage3_unit5_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_relu2 for ONNX tensor: stage3_unit5_relu2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu2 [Relu] outputs: [stage3_unit5_relu2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv2 [Conv] inputs: [stage3_unit5_relu2 -> (1, 256, 14, 14)], [stage3_unit5_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_conv2 for ONNX node: stage3_unit5_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_conv2 for ONNX tensor: stage3_unit5_conv2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv2 [Conv] outputs: [stage3_unit5_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn3 [BatchNormalization] inputs: [stage3_unit5_conv2 -> (1, 256, 14, 14)], [stage3_unit5_bn3_gamma -> (256)], [stage3_unit5_bn3_beta -> (256)], [stage3_unit5_bn3_moving_mean -> (256)], [stage3_unit5_bn3_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_bn3 for ONNX node: stage3_unit5_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_bn3 for ONNX tensor: stage3_unit5_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_bn3 [BatchNormalization] outputs: [stage3_unit5_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu3 [Relu] inputs: [stage3_unit5_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_relu3 for ONNX node: stage3_unit5_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_relu3 for ONNX tensor: stage3_unit5_relu3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_relu3 [Relu] outputs: [stage3_unit5_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit5_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv3 [Conv] inputs: [stage3_unit5_relu3 -> (1, 256, 14, 14)], [stage3_unit5_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit5_conv3 for ONNX node: stage3_unit5_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit5_conv3 for ONNX tensor: stage3_unit5_conv3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit5_conv3 [Conv] outputs: [stage3_unit5_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus11 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit5_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus10 [05/21/2021-05:46:54] [V] [TRT] _plus11 [Add] inputs: [stage3_unit5_conv3 -> (1, 1024, 14, 14)], [_plus10 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus11 for ONNX node: _plus11 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus11 for ONNX tensor: _plus11 [05/21/2021-05:46:54] [V] [TRT] _plus11 [Add] outputs: [_plus11 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus11 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn1 [BatchNormalization] inputs: [_plus11 -> (1, 1024, 14, 14)], [stage3_unit6_bn1_gamma -> (1024)], [stage3_unit6_bn1_beta -> (1024)], [stage3_unit6_bn1_moving_mean -> (1024)], [stage3_unit6_bn1_moving_var -> (1024)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_bn1 for ONNX node: stage3_unit6_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_bn1 for ONNX tensor: stage3_unit6_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn1 [BatchNormalization] outputs: [stage3_unit6_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu1 [Relu] inputs: [stage3_unit6_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_relu1 for ONNX node: stage3_unit6_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_relu1 for ONNX tensor: stage3_unit6_relu1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu1 [Relu] outputs: [stage3_unit6_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv1 [Conv] inputs: [stage3_unit6_relu1 -> (1, 1024, 14, 14)], [stage3_unit6_conv1_weight -> (256, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_conv1 for ONNX node: stage3_unit6_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_conv1 for ONNX tensor: stage3_unit6_conv1 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv1 [Conv] outputs: [stage3_unit6_conv1 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn2 [BatchNormalization] inputs: [stage3_unit6_conv1 -> (1, 256, 14, 14)], [stage3_unit6_bn2_gamma -> (256)], [stage3_unit6_bn2_beta -> (256)], [stage3_unit6_bn2_moving_mean -> (256)], [stage3_unit6_bn2_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_bn2 for ONNX node: stage3_unit6_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_bn2 for ONNX tensor: stage3_unit6_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn2 [BatchNormalization] outputs: [stage3_unit6_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu2 [Relu] inputs: [stage3_unit6_bn2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_relu2 for ONNX node: stage3_unit6_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_relu2 for ONNX tensor: stage3_unit6_relu2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu2 [Relu] outputs: [stage3_unit6_relu2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv2 [Conv] inputs: [stage3_unit6_relu2 -> (1, 256, 14, 14)], [stage3_unit6_conv2_weight -> (256, 256, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_conv2 for ONNX node: stage3_unit6_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_conv2 for ONNX tensor: stage3_unit6_conv2 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv2 [Conv] outputs: [stage3_unit6_conv2 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn3 [BatchNormalization] inputs: [stage3_unit6_conv2 -> (1, 256, 14, 14)], [stage3_unit6_bn3_gamma -> (256)], [stage3_unit6_bn3_beta -> (256)], [stage3_unit6_bn3_moving_mean -> (256)], [stage3_unit6_bn3_moving_var -> (256)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_bn3 for ONNX node: stage3_unit6_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_bn3 for ONNX tensor: stage3_unit6_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_bn3 [BatchNormalization] outputs: [stage3_unit6_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_bn3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu3 [Relu] inputs: [stage3_unit6_bn3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_relu3 for ONNX node: stage3_unit6_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_relu3 for ONNX tensor: stage3_unit6_relu3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_relu3 [Relu] outputs: [stage3_unit6_relu3 -> (1, 256, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage3_unit6_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv3 [Conv] inputs: [stage3_unit6_relu3 -> (1, 256, 14, 14)], [stage3_unit6_conv3_weight -> (1024, 256, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage3_unit6_conv3 for ONNX node: stage3_unit6_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage3_unit6_conv3 for ONNX tensor: stage3_unit6_conv3 [05/21/2021-05:46:54] [V] [TRT] stage3_unit6_conv3 [Conv] outputs: [stage3_unit6_conv3 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus12 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage3_unit6_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus11 [05/21/2021-05:46:54] [V] [TRT] _plus12 [Add] inputs: [stage3_unit6_conv3 -> (1, 1024, 14, 14)], [_plus11 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus12 for ONNX node: _plus12 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus12 for ONNX tensor: _plus12 [05/21/2021-05:46:54] [V] [TRT] _plus12 [Add] outputs: [_plus12 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus12 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn1 [BatchNormalization] inputs: [_plus12 -> (1, 1024, 14, 14)], [stage4_unit1_bn1_gamma -> (1024)], [stage4_unit1_bn1_beta -> (1024)], [stage4_unit1_bn1_moving_mean -> (1024)], [stage4_unit1_bn1_moving_var -> (1024)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_bn1 for ONNX node: stage4_unit1_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_bn1 for ONNX tensor: stage4_unit1_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn1 [BatchNormalization] outputs: [stage4_unit1_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu1 [Relu] inputs: [stage4_unit1_bn1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_relu1 for ONNX node: stage4_unit1_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_relu1 for ONNX tensor: stage4_unit1_relu1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu1 [Relu] outputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv1 [Conv] inputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], [stage4_unit1_conv1_weight -> (512, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_conv1 for ONNX node: stage4_unit1_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_conv1 for ONNX tensor: stage4_unit1_conv1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv1 [Conv] outputs: [stage4_unit1_conv1 -> (1, 512, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn2 [BatchNormalization] inputs: [stage4_unit1_conv1 -> (1, 512, 14, 14)], [stage4_unit1_bn2_gamma -> (512)], [stage4_unit1_bn2_beta -> (512)], [stage4_unit1_bn2_moving_mean -> (512)], [stage4_unit1_bn2_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_bn2 for ONNX node: stage4_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_bn2 for ONNX tensor: stage4_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn2 [BatchNormalization] outputs: [stage4_unit1_bn2 -> (1, 512, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu2 [Relu] inputs: [stage4_unit1_bn2 -> (1, 512, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_relu2 for ONNX node: stage4_unit1_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_relu2 for ONNX tensor: stage4_unit1_relu2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu2 [Relu] outputs: [stage4_unit1_relu2 -> (1, 512, 14, 14)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv2 [Conv] inputs: [stage4_unit1_relu2 -> (1, 512, 14, 14)], [stage4_unit1_conv2_weight -> (512, 512, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_conv2 for ONNX node: stage4_unit1_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_conv2 for ONNX tensor: stage4_unit1_conv2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv2 [Conv] outputs: [stage4_unit1_conv2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn3 [BatchNormalization] inputs: [stage4_unit1_conv2 -> (1, 512, 7, 7)], [stage4_unit1_bn3_gamma -> (512)], [stage4_unit1_bn3_beta -> (512)], [stage4_unit1_bn3_moving_mean -> (512)], [stage4_unit1_bn3_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_bn3 for ONNX node: stage4_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_bn3 for ONNX tensor: stage4_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_bn3 [BatchNormalization] outputs: [stage4_unit1_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu3 [Relu] inputs: [stage4_unit1_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_relu3 for ONNX node: stage4_unit1_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_relu3 for ONNX tensor: stage4_unit1_relu3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_relu3 [Relu] outputs: [stage4_unit1_relu3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv3 [Conv] inputs: [stage4_unit1_relu3 -> (1, 512, 7, 7)], [stage4_unit1_conv3_weight -> (2048, 512, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_conv3 for ONNX node: stage4_unit1_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_conv3 for ONNX tensor: stage4_unit1_conv3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_conv3 [Conv] outputs: [stage4_unit1_conv3 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit1_sc [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_sc_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_sc [Conv] inputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], [stage4_unit1_sc_weight -> (2048, 1024, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit1_sc for ONNX node: stage4_unit1_sc [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit1_sc for ONNX tensor: stage4_unit1_sc [05/21/2021-05:46:54] [V] [TRT] stage4_unit1_sc [Conv] outputs: [stage4_unit1_sc -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus13 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit1_sc [05/21/2021-05:46:54] [V] [TRT] _plus13 [Add] inputs: [stage4_unit1_conv3 -> (1, 2048, 7, 7)], [stage4_unit1_sc -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus13 for ONNX node: _plus13 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus13 for ONNX tensor: _plus13 [05/21/2021-05:46:54] [V] [TRT] _plus13 [Add] outputs: [_plus13 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus13 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn1 [BatchNormalization] inputs: [_plus13 -> (1, 2048, 7, 7)], [stage4_unit2_bn1_gamma -> (2048)], [stage4_unit2_bn1_beta -> (2048)], [stage4_unit2_bn1_moving_mean -> (2048)], [stage4_unit2_bn1_moving_var -> (2048)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_bn1 for ONNX node: stage4_unit2_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_bn1 for ONNX tensor: stage4_unit2_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn1 [BatchNormalization] outputs: [stage4_unit2_bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu1 [Relu] inputs: [stage4_unit2_bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_relu1 for ONNX node: stage4_unit2_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_relu1 for ONNX tensor: stage4_unit2_relu1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu1 [Relu] outputs: [stage4_unit2_relu1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv1 [Conv] inputs: [stage4_unit2_relu1 -> (1, 2048, 7, 7)], [stage4_unit2_conv1_weight -> (512, 2048, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_conv1 for ONNX node: stage4_unit2_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_conv1 for ONNX tensor: stage4_unit2_conv1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv1 [Conv] outputs: [stage4_unit2_conv1 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn2 [BatchNormalization] inputs: [stage4_unit2_conv1 -> (1, 512, 7, 7)], [stage4_unit2_bn2_gamma -> (512)], [stage4_unit2_bn2_beta -> (512)], [stage4_unit2_bn2_moving_mean -> (512)], [stage4_unit2_bn2_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_bn2 for ONNX node: stage4_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_bn2 for ONNX tensor: stage4_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn2 [BatchNormalization] outputs: [stage4_unit2_bn2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu2 [Relu] inputs: [stage4_unit2_bn2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_relu2 for ONNX node: stage4_unit2_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_relu2 for ONNX tensor: stage4_unit2_relu2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu2 [Relu] outputs: [stage4_unit2_relu2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv2 [Conv] inputs: [stage4_unit2_relu2 -> (1, 512, 7, 7)], [stage4_unit2_conv2_weight -> (512, 512, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_conv2 for ONNX node: stage4_unit2_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_conv2 for ONNX tensor: stage4_unit2_conv2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv2 [Conv] outputs: [stage4_unit2_conv2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn3 [BatchNormalization] inputs: [stage4_unit2_conv2 -> (1, 512, 7, 7)], [stage4_unit2_bn3_gamma -> (512)], [stage4_unit2_bn3_beta -> (512)], [stage4_unit2_bn3_moving_mean -> (512)], [stage4_unit2_bn3_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_bn3 for ONNX node: stage4_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_bn3 for ONNX tensor: stage4_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_bn3 [BatchNormalization] outputs: [stage4_unit2_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu3 [Relu] inputs: [stage4_unit2_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_relu3 for ONNX node: stage4_unit2_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_relu3 for ONNX tensor: stage4_unit2_relu3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_relu3 [Relu] outputs: [stage4_unit2_relu3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit2_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv3 [Conv] inputs: [stage4_unit2_relu3 -> (1, 512, 7, 7)], [stage4_unit2_conv3_weight -> (2048, 512, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit2_conv3 for ONNX node: stage4_unit2_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit2_conv3 for ONNX tensor: stage4_unit2_conv3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit2_conv3 [Conv] outputs: [stage4_unit2_conv3 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus14 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit2_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus13 [05/21/2021-05:46:54] [V] [TRT] _plus14 [Add] inputs: [stage4_unit2_conv3 -> (1, 2048, 7, 7)], [_plus13 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus14 for ONNX node: _plus14 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus14 for ONNX tensor: _plus14 [05/21/2021-05:46:54] [V] [TRT] _plus14 [Add] outputs: [_plus14 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus14 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn1 [BatchNormalization] inputs: [_plus14 -> (1, 2048, 7, 7)], [stage4_unit3_bn1_gamma -> (2048)], [stage4_unit3_bn1_beta -> (2048)], [stage4_unit3_bn1_moving_mean -> (2048)], [stage4_unit3_bn1_moving_var -> (2048)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_bn1 for ONNX node: stage4_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_bn1 for ONNX tensor: stage4_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn1 [BatchNormalization] outputs: [stage4_unit3_bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu1 [Relu] inputs: [stage4_unit3_bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_relu1 for ONNX node: stage4_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_relu1 for ONNX tensor: stage4_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu1 [Relu] outputs: [stage4_unit3_relu1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_conv1 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_relu1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv1_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv1 [Conv] inputs: [stage4_unit3_relu1 -> (1, 2048, 7, 7)], [stage4_unit3_conv1_weight -> (512, 2048, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_conv1 for ONNX node: stage4_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_conv1 for ONNX tensor: stage4_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv1 [Conv] outputs: [stage4_unit3_conv1 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_bn2 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv1 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn2_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn2_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn2_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn2_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn2 [BatchNormalization] inputs: [stage4_unit3_conv1 -> (1, 512, 7, 7)], [stage4_unit3_bn2_gamma -> (512)], [stage4_unit3_bn2_beta -> (512)], [stage4_unit3_bn2_moving_mean -> (512)], [stage4_unit3_bn2_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_bn2 for ONNX node: stage4_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_bn2 for ONNX tensor: stage4_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn2 [BatchNormalization] outputs: [stage4_unit3_bn2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_relu2 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu2 [Relu] inputs: [stage4_unit3_bn2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_relu2 for ONNX node: stage4_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_relu2 for ONNX tensor: stage4_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu2 [Relu] outputs: [stage4_unit3_relu2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_conv2 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_relu2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv2_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv2 [Conv] inputs: [stage4_unit3_relu2 -> (1, 512, 7, 7)], [stage4_unit3_conv2_weight -> (512, 512, 3, 3)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_conv2 for ONNX node: stage4_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_conv2 for ONNX tensor: stage4_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv2 [Conv] outputs: [stage4_unit3_conv2 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_bn3 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv2 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn3_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn3_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn3_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn3_moving_var [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn3 [BatchNormalization] inputs: [stage4_unit3_conv2 -> (1, 512, 7, 7)], [stage4_unit3_bn3_gamma -> (512)], [stage4_unit3_bn3_beta -> (512)], [stage4_unit3_bn3_moving_mean -> (512)], [stage4_unit3_bn3_moving_var -> (512)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_bn3 for ONNX node: stage4_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_bn3 for ONNX tensor: stage4_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_bn3 [BatchNormalization] outputs: [stage4_unit3_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_relu3 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu3 [Relu] inputs: [stage4_unit3_bn3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_relu3 for ONNX node: stage4_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_relu3 for ONNX tensor: stage4_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_relu3 [Relu] outputs: [stage4_unit3_relu3 -> (1, 512, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: stage4_unit3_conv3 [Conv] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_relu3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv3_weight [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv3 [Conv] inputs: [stage4_unit3_relu3 -> (1, 512, 7, 7)], [stage4_unit3_conv3_weight -> (2048, 512, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering layer: stage4_unit3_conv3 for ONNX node: stage4_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048 [05/21/2021-05:46:54] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: stage4_unit3_conv3 for ONNX tensor: stage4_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] stage4_unit3_conv3 [Conv] outputs: [stage4_unit3_conv3 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: _plus15 [Add] [05/21/2021-05:46:54] [V] [TRT] Searching for input: stage4_unit3_conv3 [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus14 [05/21/2021-05:46:54] [V] [TRT] _plus15 [Add] inputs: [stage4_unit3_conv3 -> (1, 2048, 7, 7)], [_plus14 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: _plus15 for ONNX node: _plus15 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: _plus15 for ONNX tensor: _plus15 [05/21/2021-05:46:54] [V] [TRT] _plus15 [Add] outputs: [_plus15 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: bn1 [BatchNormalization] [05/21/2021-05:46:54] [V] [TRT] Searching for input: _plus15 [05/21/2021-05:46:54] [V] [TRT] Searching for input: bn1_gamma [05/21/2021-05:46:54] [V] [TRT] Searching for input: bn1_beta [05/21/2021-05:46:54] [V] [TRT] Searching for input: bn1_moving_mean [05/21/2021-05:46:54] [V] [TRT] Searching for input: bn1_moving_var [05/21/2021-05:46:54] [V] [TRT] bn1 [BatchNormalization] inputs: [_plus15 -> (1, 2048, 7, 7)], [bn1_gamma -> (2048)], [bn1_beta -> (2048)], [bn1_moving_mean -> (2048)], [bn1_moving_var -> (2048)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: bn1 for ONNX node: bn1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: bn1 for ONNX tensor: bn1 [05/21/2021-05:46:54] [V] [TRT] bn1 [BatchNormalization] outputs: [bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: relu1 [Relu] [05/21/2021-05:46:54] [V] [TRT] Searching for input: bn1 [05/21/2021-05:46:54] [V] [TRT] relu1 [Relu] inputs: [bn1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: relu1 for ONNX node: relu1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: relu1 for ONNX tensor: relu1 [05/21/2021-05:46:54] [V] [TRT] relu1 [Relu] outputs: [relu1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: pool1 [GlobalAveragePool] [05/21/2021-05:46:54] [V] [TRT] Searching for input: relu1 [05/21/2021-05:46:54] [V] [TRT] pool1 [GlobalAveragePool] inputs: [relu1 -> (1, 2048, 7, 7)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: pool1 for ONNX node: pool1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: pool1 for ONNX tensor: pool1 [05/21/2021-05:46:54] [V] [TRT] pool1 [GlobalAveragePool] outputs: [pool1 -> (1, 2048, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: flatten0 [Flatten] [05/21/2021-05:46:54] [V] [TRT] Searching for input: pool1 [05/21/2021-05:46:54] [V] [TRT] flatten0 [Flatten] inputs: [pool1 -> (1, 2048, 1, 1)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: flatten0 for ONNX node: flatten0 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: flatten0 for ONNX tensor: flatten0 [05/21/2021-05:46:54] [V] [TRT] flatten0 [Flatten] outputs: [flatten0 -> (1, 2048)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: flatten_434 [Flatten] [05/21/2021-05:46:54] [V] [TRT] Searching for input: flatten0 [05/21/2021-05:46:54] [V] [TRT] flatten_434 [Flatten] inputs: [flatten0 -> (1, 2048)], [05/21/2021-05:46:54] [V] [TRT] Registering tensor: flatten_434 for ONNX tensor: flatten_434 [05/21/2021-05:46:54] [V] [TRT] flatten_434 [Flatten] outputs: [flatten_434 -> (1, 2048)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: fc1 [Gemm] [05/21/2021-05:46:54] [V] [TRT] Searching for input: flatten_434 [05/21/2021-05:46:54] [V] [TRT] Searching for input: fc1_weight [05/21/2021-05:46:54] [V] [TRT] Searching for input: fc1_bias [05/21/2021-05:46:54] [V] [TRT] fc1 [Gemm] inputs: [flatten_434 -> (1, 2048)], [fc1_weight -> (1000, 2048)], [fc1_bias -> (1000)], [05/21/2021-05:46:54] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met. [05/21/2021-05:46:54] [V] [TRT] Original shape: (1, 2048), unsqueezing to: (1, 2048, 1, 1) [05/21/2021-05:46:54] [V] [TRT] Registering layer: fc1 for ONNX node: fc1 [05/21/2021-05:46:54] [V] [TRT] Original shape: (1, 1000, 1, 1), squeezing to: (1, 1000) [05/21/2021-05:46:54] [V] [TRT] Registering tensor: fc1 for ONNX tensor: fc1 [05/21/2021-05:46:54] [V] [TRT] fc1 [Gemm] outputs: [fc1 -> (1, 1000)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: cast1 [Cast] [05/21/2021-05:46:54] [V] [TRT] Searching for input: fc1 [05/21/2021-05:46:54] [V] [TRT] cast1 [Cast] inputs: [fc1 -> (1, 1000)], [05/21/2021-05:46:54] [V] [TRT] Casting to type: float32 [05/21/2021-05:46:54] [W] [TRT] Tensor DataType is determined at build time for tensors not marked as input or output. [05/21/2021-05:46:54] [V] [TRT] Registering layer: cast1 for ONNX node: cast1 [05/21/2021-05:46:54] [V] [TRT] Registering tensor: cast1 for ONNX tensor: cast1 [05/21/2021-05:46:54] [V] [TRT] cast1 [Cast] outputs: [cast1 -> (1, 1000)], [05/21/2021-05:46:54] [V] [TRT] Parsing node: softmax [Softmax] [05/21/2021-05:46:54] [V] [TRT] Searching for input: cast1 [05/21/2021-05:46:54] [V] [TRT] softmax [Softmax] inputs: [cast1 -> (1, 1000)], [05/21/2021-05:46:54] [V] [TRT] Registering layer: softmax for ONNX node: softmax [05/21/2021-05:46:54] [V] [TRT] Registering tensor: softmax_259 for ONNX tensor: softmax [05/21/2021-05:46:54] [V] [TRT] softmax [Softmax] outputs: [softmax -> (1, 1000)], [05/21/2021-05:46:54] [V] [TRT] Marking softmax_259 as output: softmax [05/21/2021-05:46:54] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 548, GPU 10788 (MiB) [05/21/2021-05:46:54] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 548 MiB, GPU 10788 MiB [05/21/2021-05:46:54] [V] [TRT] Applying generic optimizations to the graph for inference. [05/21/2021-05:46:54] [V] [TRT] Original: 181 layers [05/21/2021-05:46:54] [V] [TRT] After dead-layer removal: 181 layers [05/21/2021-05:46:54] [V] [TRT] ShuffleShuffleFusion: Fusing flatten0 with (Unnamed Layer* 174) [Shuffle] [05/21/2021-05:46:54] [V] [TRT] Removing flatten0 + (Unnamed Layer* 174) [Shuffle] [05/21/2021-05:46:54] [V] [TRT] Removing (Unnamed Layer* 178) [Shuffle] [05/21/2021-05:46:54] [V] [TRT] Removing (Unnamed Layer* 180) [Shuffle] [05/21/2021-05:46:54] [V] [TRT] After Myelin optimization: 177 layers [05/21/2021-05:46:54] [V] [TRT] Convert layer type of fc1 from FULLY_CONNECTED to CONVOLUTION [05/21/2021-05:46:54] [V] [TRT] Removing shuffle_between_pool1_and_fc1 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from conv0 with scale bn0 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit1_conv1 with scale stage1_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit1_conv2 with scale stage1_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit2_conv1 with scale stage1_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit2_conv2 with scale stage1_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit3_conv1 with scale stage1_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage1_unit3_conv2 with scale stage1_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit1_conv1 with scale stage2_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit1_conv2 with scale stage2_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit2_conv1 with scale stage2_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit2_conv2 with scale stage2_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit3_conv1 with scale stage2_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit3_conv2 with scale stage2_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit4_conv1 with scale stage2_unit4_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage2_unit4_conv2 with scale stage2_unit4_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit1_conv1 with scale stage3_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit1_conv2 with scale stage3_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit2_conv1 with scale stage3_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit2_conv2 with scale stage3_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit3_conv1 with scale stage3_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit3_conv2 with scale stage3_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit4_conv1 with scale stage3_unit4_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit4_conv2 with scale stage3_unit4_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit5_conv1 with scale stage3_unit5_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit5_conv2 with scale stage3_unit5_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit6_conv1 with scale stage3_unit6_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage3_unit6_conv2 with scale stage3_unit6_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit1_conv1 with scale stage4_unit1_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit1_conv2 with scale stage4_unit1_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit2_conv1 with scale stage4_unit2_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit2_conv2 with scale stage4_unit2_bn3 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit3_conv1 with scale stage4_unit3_bn2 [05/21/2021-05:46:54] [V] [TRT] Fusing convolution weights from stage4_unit3_conv2 with scale stage4_unit3_bn3 [05/21/2021-05:46:54] [V] [TRT] After scale fusion: 144 layers [05/21/2021-05:46:54] [V] [TRT] ConvReluFusion: Fusing conv0 with relu0 [05/21/2021-05:46:54] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit1_bn1 with stage1_unit1_relu1 [05/21/2021-05:46:54] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit1_sc with _plus0 [05/21/2021-05:46:54] [V] [TRT] ConvReluFusion: Fusing stage1_unit1_conv1 with stage1_unit1_relu2 [05/21/2021-05:46:54] [V] [TRT] ConvReluFusion: Fusing stage1_unit1_conv2 with stage1_unit1_relu3 [05/21/2021-05:46:54] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit2_bn1 with stage1_unit2_relu1 [05/21/2021-05:46:54] [V] [TRT] ConvReluFusion: Fusing stage1_unit2_conv1 with stage1_unit2_relu2 [05/21/2021-05:46:54] [V] [TRT] ConvReluFusion: Fusing stage1_unit2_conv2 with stage1_unit2_relu3 [05/21/2021-05:46:54] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit2_conv3 with _plus1 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit3_bn1 with stage1_unit3_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage1_unit3_conv1 with stage1_unit3_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage1_unit3_conv2 with stage1_unit3_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit3_conv3 with _plus2 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit1_bn1 with stage2_unit1_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit1_sc with _plus3 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit1_conv1 with stage2_unit1_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit1_conv2 with stage2_unit1_relu3 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit2_bn1 with stage2_unit2_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit2_conv1 with stage2_unit2_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit2_conv2 with stage2_unit2_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit2_conv3 with _plus4 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit3_bn1 with stage2_unit3_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit3_conv1 with stage2_unit3_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit3_conv2 with stage2_unit3_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit3_conv3 with _plus5 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit4_bn1 with stage2_unit4_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit4_conv1 with stage2_unit4_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage2_unit4_conv2 with stage2_unit4_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit4_conv3 with _plus6 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit1_bn1 with stage3_unit1_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit1_sc with _plus7 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit1_conv1 with stage3_unit1_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit1_conv2 with stage3_unit1_relu3 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit2_bn1 with stage3_unit2_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit2_conv1 with stage3_unit2_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit2_conv2 with stage3_unit2_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit2_conv3 with _plus8 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit3_bn1 with stage3_unit3_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit3_conv1 with stage3_unit3_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit3_conv2 with stage3_unit3_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit3_conv3 with _plus9 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit4_bn1 with stage3_unit4_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit4_conv1 with stage3_unit4_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit4_conv2 with stage3_unit4_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit4_conv3 with _plus10 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit5_bn1 with stage3_unit5_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit5_conv1 with stage3_unit5_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit5_conv2 with stage3_unit5_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit5_conv3 with _plus11 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit6_bn1 with stage3_unit6_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit6_conv1 with stage3_unit6_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage3_unit6_conv2 with stage3_unit6_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit6_conv3 with _plus12 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit1_bn1 with stage4_unit1_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit1_sc with _plus13 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit1_conv1 with stage4_unit1_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit1_conv2 with stage4_unit1_relu3 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit2_bn1 with stage4_unit2_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit2_conv1 with stage4_unit2_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit2_conv2 with stage4_unit2_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit2_conv3 with _plus14 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit3_bn1 with stage4_unit3_relu1 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit3_conv1 with stage4_unit3_relu2 [05/21/2021-05:46:55] [V] [TRT] ConvReluFusion: Fusing stage4_unit3_conv2 with stage4_unit3_relu3 [05/21/2021-05:46:55] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit3_conv3 with _plus15 [05/21/2021-05:46:55] [V] [TRT] ScaleActivationFusion: Fusing bn1 with relu1 [05/21/2021-05:46:55] [V] [TRT] Swap the layer type of pool1 from REDUCE to POOLING [05/21/2021-05:46:55] [W] [TRT] Convolution + generic activation fusion is disable due to incompatible driver or nvrtc [05/21/2021-05:46:55] [V] [TRT] After vertical fusions: 78 layers [05/21/2021-05:46:55] [V] [TRT] After dupe layer removal: 78 layers [05/21/2021-05:46:55] [V] [TRT] After final dead-layer removal: 78 layers [05/21/2021-05:46:55] [V] [TRT] After tensor merging: 78 layers [05/21/2021-05:46:55] [V] [TRT] After concat removal: 78 layers [05/21/2021-05:46:55] [V] [TRT] Graph construction and optimization completed in 1.012 seconds. [05/21/2021-05:46:56] [V] [TRT] Using cublasLt a tactic source [05/21/2021-05:46:56] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +653, GPU +272, now: CPU 1261, GPU 11060 (MiB) [05/21/2021-05:46:56] [V] [TRT] Using cuDNN as a tactic source [05/21/2021-05:46:56] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +637, GPU +260, now: CPU 1898, GPU 11320 (MiB) [05/21/2021-05:46:56] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4 [05/21/2021-05:46:56] [W] [TRT] Detected invalid timing cache, setup a local cache instead [05/21/2021-05:46:56] [V] [TRT] Constructing optimization profile number 0 [1/1]. [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.034176 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.015872 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(50176,50176:32,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.030224 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.058796 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.030224 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.006632 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.0076 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.004268 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004268 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.01678 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.00832 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00832 [05/21/2021-05:46:56] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:56] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:56] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:56] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.007836 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:46:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:56] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:56] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.007452 [05/21/2021-05:46:56] [V] [TRT] Tactic: 0 Time: 0.004176 [05/21/2021-05:46:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004176 [05/21/2021-05:46:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:56] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:56] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:56] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:56] [V] [TRT] Tactic: 1002 Time: 0.016384 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.00818 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00818 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.017408 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.005544 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005544 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.008168 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.00548 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00548 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.018176 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.01804 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.008704 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.008704 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.016952 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.005516 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005516 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.008196 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.018004 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.0068 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0068 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.018228 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.009228 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.009228 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.019008 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.011392 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.011392 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.010752 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.00704 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00704 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.017408 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.006912 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.006912 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.017664 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.009728 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.009728 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.007968 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.003456 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.010496 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.0096 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.008704 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.008704 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.037596 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.022528 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.018304 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.01746 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.008432 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.008432 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.035088 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.022916 [05/21/2021-05:46:57] [V] [TRT] Tactic: 0 Time: 0.004172 [05/21/2021-05:46:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004172 [05/21/2021-05:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:57] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:57] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:57] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:57] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.006748 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006748 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:58] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.01846 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00896 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00896 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:58] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.036136 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.006572 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006572 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:58] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.022548 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.0064 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:58] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018488 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.006656 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Cast) [05/21/2021-05:46:58] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: cast0 (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018688 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.030872 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005196 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005196 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.02048 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005096 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005096 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.017408 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004468 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004468 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.007172 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.0051 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0051 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.017428 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.006656 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018048 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.008576 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.008576 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.030848 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.022528 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005284 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005284 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.016844 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005512 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005512 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.008244 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.0181 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.006952 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.006952 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018212 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004868 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004868 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018688 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00434 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00434 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.016384 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.00942 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004132 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.008236 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004652 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004652 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.009728 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.008704 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.008704 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.01764 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.008328 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00604 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00604 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.03736 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018328 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.018304 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.0178 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004388 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004388 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.020684 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00482 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00482 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.017408 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.00524 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00524 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:58] [V] [TRT] Tactic: 1002 Time: 0.0352 [05/21/2021-05:46:58] [V] [TRT] Tactic: 0 Time: 0.004132 [05/21/2021-05:46:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [05/21/2021-05:46:58] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.02254 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004436 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004436 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.01846 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.009088 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.009088 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.017672 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.006448 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006448 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.0215 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005424 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005424 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.01856 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.006032 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006032 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.036224 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.006444 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006444 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.022668 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.006272 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.006528 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Float(150528,50176,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Float(150528,1,672,3) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Float(50176,1:4,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(150528,50176,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004236 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004236 [05/21/2021-05:46:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(100352,50176:2,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:46:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:8,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,224,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: bn_data (Scale) [05/21/2021-05:46:59] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.006836 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004824 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004824 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005688 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005688 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.00892 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.01788 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(150528,50176,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.017664 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(150528,1,672,3) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.0077 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005356 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005356 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(150528,50176,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.037152 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.004636 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.004636 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(100352,50176:2,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.022912 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(50176,1:8,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.018564 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.0064 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(50176,1:16,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.00896 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00896 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005444 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005444 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(50176,1:4,224,1) (Reformat) [05/21/2021-05:46:59] [V] [TRT] Tactic: 1002 Time: 0.018228 [05/21/2021-05:46:59] [V] [TRT] Tactic: 0 Time: 0.005812 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.005812 [05/21/2021-05:46:59] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Float(802816,12544,112,1) *************** [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudaDepthwiseConvolution) [05/21/2021-05:46:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (FusedConvActConvolution) [05/21/2021-05:46:59] [V] [TRT] Tactic: 131071 Time: 0.036004 [05/21/2021-05:46:59] [V] [TRT] Tactic: 3276799 Time: 0.038656 [05/21/2021-05:46:59] [V] [TRT] Tactic: 8454143 Time: 0.039056 [05/21/2021-05:46:59] [V] [TRT] Fastest Tactic: 131071 Time: 0.036004 [05/21/2021-05:46:59] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:00] [V] [TRT] Tactic: 0 Time: 0.051732 [05/21/2021-05:47:00] [V] [TRT] Tactic: 1 Time: 0.0474 [05/21/2021-05:47:00] [V] [TRT] Tactic: 2 Time: 0.057984 [05/21/2021-05:47:00] [V] [TRT] Tactic: 5 Time: 1.01918 [05/21/2021-05:47:00] [V] [TRT] Tactic: 56 Time: 0.052224 [05/21/2021-05:47:00] [V] [TRT] Tactic: 57 Time: 0.047212 [05/21/2021-05:47:00] [V] [TRT] Tactic: 58 Time: 0.05824 [05/21/2021-05:47:00] [V] [TRT] Tactic: 61 Time: 1.02094 [05/21/2021-05:47:00] [V] [TRT] Tactic: 112 Time: 0.052096 [05/21/2021-05:47:00] [V] [TRT] Tactic: 113 Time: 0.0473 [05/21/2021-05:47:00] [V] [TRT] Tactic: 114 Time: 0.057604 [05/21/2021-05:47:00] [V] [TRT] Tactic: 117 Time: 1.06106 [05/21/2021-05:47:00] [V] [TRT] Fastest Tactic: 57 Time: 0.047212 [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:47:00] [V] [TRT] Tactic: 6053873026024413720 Time: 0.046696 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:47:00] [V] [TRT] Tactic: 6767548733843469815 Time: 0.027216 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:00] [V] [TRT] Tactic: -1123676555321336786 Time: 0.044248 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:00] [V] [TRT] Tactic: -701551393537224327 Time: 0.029184 [05/21/2021-05:47:00] [V] [TRT] Fastest Tactic: 6767548733843469815 Time: 0.027216 [05/21/2021-05:47:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6767548733843469815 [05/21/2021-05:47:00] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Float(802816,1,7168,64) *************** [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:00] [V] [TRT] Tactic: -3855385237722507464 Time: 0.094168 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.093836 [05/21/2021-05:47:00] [V] [TRT] Fastest Tactic: -2809379259463049391 Time: 0.093836 [05/21/2021-05:47:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2809379259463049391 [05/21/2021-05:47:00] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Float(200704,1:4,1792,16) *************** [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.159624 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.103852 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:47:00] [V] [TRT] Tactic: 7155825427510256858 Time: 0.091428 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:47:00] [V] [TRT] Tactic: 7342025736444949634 Time: 0.124416 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.090368 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:47:00] [V] [TRT] Tactic: -4756382386362004279 Time: 0.101648 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:00] [V] [TRT] Tactic: -3855385237722507464 Time: 0.093336 [05/21/2021-05:47:00] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.094336 [05/21/2021-05:47:00] [V] [TRT] Fastest Tactic: 8918020581761223752 Time: 0.090368 [05/21/2021-05:47:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8918020581761223752 [05/21/2021-05:47:00] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(802816,12544,112,1) *************** [05/21/2021-05:47:00] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:00] [V] [TRT] Tactic: 0 Time: 0.037352 [05/21/2021-05:47:00] [V] [TRT] Tactic: 1 Time: 0.037296 [05/21/2021-05:47:00] [V] [TRT] Tactic: 2 Time: 0.054688 [05/21/2021-05:47:00] [V] [TRT] Tactic: 5 Time: 0.989164 [05/21/2021-05:47:00] [V] [TRT] Tactic: 56 Time: 0.039176 [05/21/2021-05:47:00] [V] [TRT] Tactic: 58 Time: 0.054656 [05/21/2021-05:47:01] [V] [TRT] Tactic: 61 Time: 1.02668 [05/21/2021-05:47:01] [V] [TRT] Fastest Tactic: 1 Time: 0.037296 [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:47:01] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(401408,12544:2,112,1) *************** [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (FusedConvActConvolution) [05/21/2021-05:47:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2195670545862694453 Time: 0.024244 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:47:01] [V] [TRT] Tactic: 3419182076704469245 Time: 0.024184 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:01] [V] [TRT] Tactic: 3891805945559659536 Time: 0.039936 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:01] [V] [TRT] Tactic: 5548126322150286555 Time: 0.023868 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:47:01] [V] [TRT] Tactic: -7928611605886347652 Time: 0.039968 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:47:01] [V] [TRT] Tactic: -5172391392092686714 Time: 0.023668 [05/21/2021-05:47:01] [V] [TRT] Fastest Tactic: -5172391392092686714 Time: 0.023668 [05/21/2021-05:47:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5172391392092686714 [05/21/2021-05:47:01] [V] [TRT] *************** Autotuning format combination: Half(50176,1:4,224,1) -> Half(100352,1:8,896,8) *************** [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Float(802816,12544,112,1) *************** [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(100352,1:8,896,8) *************** [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudaDepthwiseConvolution) [05/21/2021-05:47:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:01] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.135424 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:47:01] [V] [TRT] Tactic: 1011057357468998345 Time: 0.068736 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:01] [V] [TRT] Tactic: 1156328698016730421 Time: 0.12108 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:01] [V] [TRT] Tactic: 1832046141070096030 Time: 0.093096 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2428167804343994714 Time: 0.0704 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2541579301352125276 Time: 0.149248 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2819719497590964443 Time: 0.119168 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2968605903460894194 Time: 0.083712 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:47:01] [V] [TRT] Tactic: 2986078304285316765 Time: 0.150528 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:01] [V] [TRT] Tactic: 3362537467505018070 Time: 0.118768 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:01] [V] [TRT] Tactic: 3513075359009385578 Time: 0.119584 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:47:01] [V] [TRT] Tactic: 3573559043797674382 Time: 0.093312 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:47:01] [V] [TRT] Tactic: 5368829646735632944 Time: 0.068224 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:47:01] [V] [TRT] Tactic: 5746691132547383910 Time: 0.117376 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:47:01] [V] [TRT] Tactic: 5770170567977052602 Time: 0.092556 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:47:01] [V] [TRT] Tactic: 6074229447555668232 Time: 0.090636 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:47:01] [V] [TRT] Tactic: 6446388116965632819 Time: 0.091204 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.08538 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:47:01] [V] [TRT] Tactic: 6642277870194067185 Time: 0.121088 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.090368 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.04222 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:01] [V] [TRT] Tactic: 7609923741161019135 Time: 0.091124 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:47:01] [V] [TRT] Tactic: 7705739241028240201 Time: 0.091516 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:47:01] [V] [TRT] Tactic: 8072087735545283117 Time: 0.117748 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:01] [V] [TRT] Tactic: 8101703987960976805 Time: 0.08866 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:47:01] [V] [TRT] Tactic: -9217371357561775773 Time: 0.088112 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:01] [V] [TRT] Tactic: -9009272790678027912 Time: 0.093952 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:47:01] [V] [TRT] Tactic: -8949544755481315679 Time: 0.08666 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:47:01] [V] [TRT] Tactic: -8759929675070720385 Time: 0.119168 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:01] [V] [TRT] Tactic: -8604374562669615024 Time: 0.092 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:47:01] [V] [TRT] Tactic: -6840588038605932325 Time: 0.129024 [05/21/2021-05:47:01] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:47:02] [V] [TRT] Tactic: -6525498856028268801 Time: 0.034848 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:02] [V] [TRT] Tactic: -6356316196810535311 Time: 0.089112 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:47:02] [V] [TRT] Tactic: -6257787336162086472 Time: 0.12088 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:47:02] [V] [TRT] Tactic: -5777580938094193096 Time: 0.057648 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:47:02] [V] [TRT] Tactic: -5657273398217409378 Time: 0.061016 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:02] [V] [TRT] Tactic: -5161596964442251102 Time: 0.117784 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:02] [V] [TRT] Tactic: -5127240325355316006 Time: 0.128256 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:47:02] [V] [TRT] Tactic: -4706569565442112734 Time: 0.08962 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:47:02] [V] [TRT] Tactic: -4409144516525410768 Time: 0.119696 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:02] [V] [TRT] Tactic: -4021926646879732549 Time: 0.12906 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:02] [V] [TRT] Tactic: -3987638434926559037 Time: 0.118668 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:02] [V] [TRT] Tactic: -3905653247016903130 Time: 0.066988 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:47:02] [V] [TRT] Tactic: -3903974568488493144 Time: 0.043648 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:47:02] [V] [TRT] Tactic: -3895429239811098010 Time: 0.126128 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:47:02] [V] [TRT] Tactic: -3412636942650049698 Time: 0.066944 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:47:02] [V] [TRT] Tactic: -2816084650627734155 Time: 0.093212 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:47:02] [V] [TRT] Tactic: -2559894581585337900 Time: 0.1344 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:47:02] [V] [TRT] Tactic: -2530740716768816092 Time: 0.062148 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:47:02] [V] [TRT] Tactic: -2241736083352441442 Time: 0.043676 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:47:02] [V] [TRT] Tactic: -2161909437867201546 Time: 0.085524 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:02] [V] [TRT] Tactic: -1985778916402815946 Time: 0.09168 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:47:02] [V] [TRT] Tactic: -1500496213132463076 Time: 0.08766 [05/21/2021-05:47:02] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:47:02] [V] [TRT] Tactic: -606726295133751039 Time: 0.05212 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: -6525498856028268801 Time: 0.034848 [05/21/2021-05:47:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6525498856028268801 [05/21/2021-05:47:02] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,448,4) *************** [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution) [05/21/2021-05:47:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution) [05/21/2021-05:47:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.014848 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.013312 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.013312 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.014768 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.0094 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.0094 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.012696 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.01114 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.01114 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.015872 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.013756 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.013756 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.013368 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.01472 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.011432 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.011432 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.018828 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.015512 [05/21/2021-05:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.015512 [05/21/2021-05:47:02] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:02] [V] [TRT] Tactic: 1002 Time: 0.013756 [05/21/2021-05:47:02] [V] [TRT] Tactic: 0 Time: 0.015104 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.013756 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.014356 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.015408 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.014356 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.012544 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.011892 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.011892 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.01536 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.011024 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.011024 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.01408 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.007808 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007808 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.011432 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.00754 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00754 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.01706 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.008584 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008584 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.023856 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.007372 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.007372 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.012704 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.006784 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.006784 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:03] [V] [TRT] Tactic: 1002 Time: 0.014464 [05/21/2021-05:47:03] [V] [TRT] Tactic: 0 Time: 0.008124 [05/21/2021-05:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.008124 [05/21/2021-05:47:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.020312 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.006216 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.006216 [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.012928 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Float(802816,12544,112,1) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.013312 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.013332 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(802816,12544,112,1) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.01938 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.013328 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.013328 [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(401408,12544:2,112,1) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.01344 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.014336 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.01344 [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(100352,1:8,896,8) (Reformat) [05/21/2021-05:47:04] [V] [TRT] Tactic: 1002 Time: 0.010576 [05/21/2021-05:47:04] [V] [TRT] Tactic: 0 Time: 0.011192 [05/21/2021-05:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.010576 [05/21/2021-05:47:04] [V] [TRT] *************** Autotuning format combination: Float(802816,12544,112,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:04] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling) [05/21/2021-05:47:04] [V] [TRT] Tactic: 257 Time: 0.010752 [05/21/2021-05:47:04] [V] [TRT] Tactic: 65793 Time: 0.010084 [05/21/2021-05:47:04] [V] [TRT] Tactic: 131329 Time: 0.015232 [05/21/2021-05:47:04] [V] [TRT] Tactic: 196865 Time: 0.01386 [05/21/2021-05:47:04] [V] [TRT] Tactic: 262401 Time: 0.011568 [05/21/2021-05:47:04] [V] [TRT] Tactic: 327937 Time: 0.013104 [05/21/2021-05:47:04] [V] [TRT] Tactic: 393473 Time: 0.015232 [05/21/2021-05:47:04] [V] [TRT] Tactic: 459009 Time: 0.009 [05/21/2021-05:47:04] [V] [TRT] Tactic: 524545 Time: 0.008576 [05/21/2021-05:47:04] [V] [TRT] Tactic: 590081 Time: 0.0105 [05/21/2021-05:47:04] [V] [TRT] Tactic: 655617 Time: 0.0096 [05/21/2021-05:47:04] [V] [TRT] Tactic: 721153 Time: 0.00832 [05/21/2021-05:47:04] [V] [TRT] Tactic: 786689 Time: 0.009476 [05/21/2021-05:47:04] [V] [TRT] Tactic: 852225 Time: 0.010656 [05/21/2021-05:47:04] [V] [TRT] Tactic: 917761 Time: 0.0086 [05/21/2021-05:47:04] [V] [TRT] Tactic: 983297 Time: 0.007816 [05/21/2021-05:47:04] [V] [TRT] Tactic: 1048833 Time: 0.00862 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1114369 Time: 0.009504 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1179905 Time: 0.010144 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1245441 Time: 0.009088 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1310977 Time: 0.010284 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1376513 Time: 0.008576 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1442049 Time: 0.006272 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1507585 Time: 0.008692 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1573121 Time: 0.009216 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1638657 Time: 0.009856 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1704193 Time: 0.008192 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1769729 Time: 0.009472 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1835265 Time: 0.008596 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1900801 Time: 0.006532 [05/21/2021-05:47:05] [V] [TRT] Tactic: 1966337 Time: 0.008104 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2031873 Time: 0.010368 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2097409 Time: 0.009984 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2162945 Time: 0.008448 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2228481 Time: 0.0096 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2294017 Time: 0.006144 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2359553 Time: 0.006784 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2425089 Time: 0.008656 [05/21/2021-05:47:05] [V] [TRT] Tactic: 2490625 Time: 0.009776 [05/21/2021-05:47:06] [V] [TRT] Tactic: 2556161 Time: 0.009728 [05/21/2021-05:47:06] [V] [TRT] Tactic: 2621697 Time: 0.008448 [05/21/2021-05:47:06] [V] [TRT] Tactic: 2687233 Time: 0.009112 [05/21/2021-05:47:06] [V] [TRT] Tactic: 6947073 Time: 0.007552 [05/21/2021-05:47:06] [V] [TRT] Fastest Tactic: 2294017 Time: 0.006144 [05/21/2021-05:47:06] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling) [05/21/2021-05:47:06] [V] [TRT] Tactic: -1 Time: 0.007172 [05/21/2021-05:47:06] [V] [TRT] Fastest Tactic: -1 Time: 0.007172 [05/21/2021-05:47:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 2294017 [05/21/2021-05:47:06] [V] [TRT] *************** Autotuning format combination: Half(802816,12544,112,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:06] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling) [05/21/2021-05:47:06] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [05/21/2021-05:47:06] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling) [05/21/2021-05:47:06] [V] [TRT] Tactic: -1 Time: 0.007176 [05/21/2021-05:47:06] [V] [TRT] Fastest Tactic: -1 Time: 0.007176 [05/21/2021-05:47:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [05/21/2021-05:47:06] [V] [TRT] *************** Autotuning format combination: Half(401408,12544:2,112,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:06] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling) [05/21/2021-05:47:06] [V] [TRT] Tactic: 257 Time: 0.007056 [05/21/2021-05:47:06] [V] [TRT] Tactic: 65793 Time: 0.006272 [05/21/2021-05:47:06] [V] [TRT] Tactic: 131329 Time: 0.00872 [05/21/2021-05:47:06] [V] [TRT] Tactic: 196865 Time: 0.009096 [05/21/2021-05:47:06] [V] [TRT] Tactic: 262401 Time: 0.008192 [05/21/2021-05:47:06] [V] [TRT] Tactic: 327937 Time: 0.007168 [05/21/2021-05:47:06] [V] [TRT] Tactic: 393473 Time: 0.009988 [05/21/2021-05:47:06] [V] [TRT] Tactic: 459009 Time: 0.005788 [05/21/2021-05:47:06] [V] [TRT] Tactic: 524545 Time: 0.005488 [05/21/2021-05:47:06] [V] [TRT] Tactic: 590081 Time: 0.007168 [05/21/2021-05:47:06] [V] [TRT] Tactic: 655617 Time: 0.007092 [05/21/2021-05:47:06] [V] [TRT] Tactic: 721153 Time: 0.006656 [05/21/2021-05:47:06] [V] [TRT] Tactic: 786689 Time: 0.006044 [05/21/2021-05:47:06] [V] [TRT] Tactic: 852225 Time: 0.006932 [05/21/2021-05:47:06] [V] [TRT] Tactic: 917761 Time: 0.005536 [05/21/2021-05:47:06] [V] [TRT] Tactic: 983297 Time: 0.005248 [05/21/2021-05:47:06] [V] [TRT] Tactic: 1048833 Time: 0.00694 [05/21/2021-05:47:06] [V] [TRT] Tactic: 1114369 Time: 0.006528 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1179905 Time: 0.005856 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1245441 Time: 0.0064 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1310977 Time: 0.006588 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1376513 Time: 0.00578 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1442049 Time: 0.005248 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1507585 Time: 0.00624 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1573121 Time: 0.007168 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1638657 Time: 0.006788 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1704193 Time: 0.006028 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1769729 Time: 0.006176 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1835265 Time: 0.005296 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1900801 Time: 0.005248 [05/21/2021-05:47:07] [V] [TRT] Tactic: 1966337 Time: 0.006164 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2031873 Time: 0.006016 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2097409 Time: 0.00722 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2162945 Time: 0.006032 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2228481 Time: 0.006316 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2294017 Time: 0.005376 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2359553 Time: 0.0054 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2425089 Time: 0.006392 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2490625 Time: 0.006268 [05/21/2021-05:47:07] [V] [TRT] Tactic: 2556161 Time: 0.006428 [05/21/2021-05:47:08] [V] [TRT] Tactic: 2621697 Time: 0.006188 [05/21/2021-05:47:08] [V] [TRT] Tactic: 2687233 Time: 0.006272 [05/21/2021-05:47:08] [V] [TRT] Tactic: 6947073 Time: 0.005416 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 983297 Time: 0.005248 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: pooling0 (CudaPooling) [05/21/2021-05:47:08] [V] [TRT] Tactic: -3 Time: 0.005124 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: -3 Time: 0.005124 [05/21/2021-05:47:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -3 [05/21/2021-05:47:08] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,896,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling) [05/21/2021-05:47:08] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: pooling0 (CudaPooling) [05/21/2021-05:47:08] [V] [TRT] Tactic: -2 Time: 0.00512 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: -2 Time: 0.00512 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling) [05/21/2021-05:47:08] [V] [TRT] Tactic: -1 Time: 0.005888 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: -1 Time: 0.005888 [05/21/2021-05:47:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -2 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.010292 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.005752 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005752 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.00576 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.005672 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005672 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.007972 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.004524 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004524 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.00698 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.0041 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0041 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.006476 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.00518 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00518 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.012032 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.007328 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.007328 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.009472 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.007476 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.006468 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.006468 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.007432 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.006752 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.006752 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.006444 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:47:08] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:08] [V] [TRT] Tactic: 1002 Time: 0.010924 [05/21/2021-05:47:08] [V] [TRT] Tactic: 0 Time: 0.0063 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0063 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.009236 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005368 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005368 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007176 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.007464 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.007176 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008168 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007032 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005832 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005832 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00576 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.00822 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007504 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.010368 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.0045 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0045 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008568 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008572 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008316 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004184 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004184 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007936 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007808 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004212 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004212 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007724 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005912 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005912 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.00698 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.009632 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.006084 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.006084 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.007224 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.007224 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005768 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005768 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.007936 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00704 [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:09] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.00594 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00594 [05/21/2021-05:47:09] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:09] [V] [TRT] Tactic: 0 Time: 0.004532 [05/21/2021-05:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004532 [05/21/2021-05:47:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:09] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:10] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:10] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:47:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:10] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:47:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:10] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:10] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale) [05/21/2021-05:47:10] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.011008 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006276 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006276 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.010496 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006076 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006076 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007492 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005664 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005664 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004376 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004376 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006832 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004448 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004448 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005776 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005776 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.01088 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006572 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006572 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.009472 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005256 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005256 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007644 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006576 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006576 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00668 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00668 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.011136 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.0073 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0073 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.009508 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005256 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005256 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007368 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006692 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006692 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006832 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006832 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006304 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00582 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00582 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006568 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00536 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00536 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007944 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00514 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00514 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00518 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00518 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.00928 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.008668 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.008644 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.008852 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.012416 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004136 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004136 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.007808 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.006192 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006192 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.005636 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005636 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:10] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:47:10] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:10] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.00926 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(12544,1:16,224,4) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.006064 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006064 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,3136,56,1) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.008232 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.00704 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00704 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,1,3584,64) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.007048 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.005796 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005796 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(50176,1:4,896,16) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(200704,3136,56,1) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.010368 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.00696 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00696 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(100352,3136:2,56,1) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.008064 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.00714 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00714 [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(25088,1:8,448,8) (Reformat) [05/21/2021-05:47:11] [V] [TRT] Tactic: 1002 Time: 0.007028 [05/21/2021-05:47:11] [V] [TRT] Tactic: 0 Time: 0.005936 [05/21/2021-05:47:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005936 [05/21/2021-05:47:11] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:11] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:47:11] [V] [TRT] Tactic: 589823 Time: 0.023808 [05/21/2021-05:47:11] [V] [TRT] Tactic: 655359 Time: 0.017232 [05/21/2021-05:47:11] [V] [TRT] Tactic: 786431 Time: 0.014336 [05/21/2021-05:47:11] [V] [TRT] Tactic: 851967 Time: 0.01536 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1179647 Time: 0.012312 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1310719 Time: 0.015376 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1376255 Time: 0.019456 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1441791 Time: 0.01536 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1507327 Time: 0.014336 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1638399 Time: 0.013312 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1835007 Time: 0.015488 [05/21/2021-05:47:11] [V] [TRT] Tactic: 1900543 Time: 0.018576 [05/21/2021-05:47:11] [V] [TRT] Tactic: 2097151 Time: 0.013696 [05/21/2021-05:47:11] [V] [TRT] Tactic: 2162687 Time: 0.020632 [05/21/2021-05:47:11] [V] [TRT] Tactic: 2293759 Time: 0.019968 [05/21/2021-05:47:11] [V] [TRT] Tactic: 2359295 Time: 0.015872 [05/21/2021-05:47:11] [V] [TRT] Tactic: 2686975 Time: 0.02 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3080191 Time: 0.014336 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3342335 Time: 0.015376 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3407871 Time: 0.0154 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3538943 Time: 0.014208 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3670015 Time: 0.027332 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3932159 Time: 0.01756 [05/21/2021-05:47:11] [V] [TRT] Tactic: 3997695 Time: 0.013568 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4063231 Time: 0.013312 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4194303 Time: 0.013952 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4259839 Time: 0.013316 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4325375 Time: 0.013488 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4521983 Time: 0.018456 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4587519 Time: 0.013352 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4653055 Time: 0.013316 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4915199 Time: 0.013856 [05/21/2021-05:47:11] [V] [TRT] Tactic: 4980735 Time: 0.015904 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5177343 Time: 0.013116 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5242879 Time: 0.014676 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5373951 Time: 0.013312 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5439487 Time: 0.01536 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5570559 Time: 0.014632 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5636095 Time: 0.013584 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5701631 Time: 0.018432 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5767167 Time: 0.021152 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5832703 Time: 0.014592 [05/21/2021-05:47:11] [V] [TRT] Tactic: 5898239 Time: 0.012452 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6029311 Time: 0.018608 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6225919 Time: 0.013952 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6291455 Time: 0.012544 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6422527 Time: 0.014592 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6750207 Time: 0.013568 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6815743 Time: 0.0157 [05/21/2021-05:47:11] [V] [TRT] Tactic: 6946815 Time: 0.014976 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7012351 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7077887 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7143423 Time: 0.015616 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7208959 Time: 0.014384 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7340031 Time: 0.012336 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7405567 Time: 0.01408 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7536639 Time: 0.018568 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7602175 Time: 0.013696 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7733247 Time: 0.013364 [05/21/2021-05:47:12] [V] [TRT] Tactic: 7798783 Time: 0.014676 [05/21/2021-05:47:12] [V] [TRT] Tactic: 8191999 Time: 0.013452 [05/21/2021-05:47:12] [V] [TRT] Tactic: 8257535 Time: 0.013184 [05/21/2021-05:47:12] [V] [TRT] Tactic: 8323071 Time: 0.014208 [05/21/2021-05:47:12] [V] [TRT] Tactic: 8650751 Time: 0.013696 [05/21/2021-05:47:12] [V] [TRT] Tactic: 8716287 Time: 0.014728 [05/21/2021-05:47:12] [V] [TRT] Tactic: 9109503 Time: 0.01332 [05/21/2021-05:47:12] [V] [TRT] Tactic: 9568255 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 9895935 Time: 0.014208 [05/21/2021-05:47:12] [V] [TRT] Tactic: 10223615 Time: 0.019712 [05/21/2021-05:47:12] [V] [TRT] Tactic: 10354687 Time: 0.012928 [05/21/2021-05:47:12] [V] [TRT] Tactic: 10551295 Time: 0.015376 [05/21/2021-05:47:12] [V] [TRT] Tactic: 10747903 Time: 0.01344 [05/21/2021-05:47:12] [V] [TRT] Tactic: 10944511 Time: 0.015092 [05/21/2021-05:47:12] [V] [TRT] Fastest Tactic: 1179647 Time: 0.012312 [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:12] [V] [TRT] Tactic: 0 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 1 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 2 Time: 0.031744 [05/21/2021-05:47:12] [V] [TRT] Tactic: 4 Time: 0.369616 [05/21/2021-05:47:12] [V] [TRT] Tactic: 5 Time: 0.030916 [05/21/2021-05:47:12] [V] [TRT] Tactic: 56 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] Tactic: 57 Time: 0.014336 [05/21/2021-05:47:12] [V] [TRT] Tactic: 58 Time: 0.033192 [05/21/2021-05:47:12] [V] [TRT] Tactic: 60 Time: 0.370356 [05/21/2021-05:47:12] [V] [TRT] Tactic: 61 Time: 0.032556 [05/21/2021-05:47:12] [V] [TRT] Tactic: 112 Time: 0.013764 [05/21/2021-05:47:12] [V] [TRT] Tactic: 113 Time: 0.013588 [05/21/2021-05:47:12] [V] [TRT] Tactic: 114 Time: 0.032896 [05/21/2021-05:47:12] [V] [TRT] Tactic: 116 Time: 0.37052 [05/21/2021-05:47:12] [V] [TRT] Tactic: 117 Time: 0.033088 [05/21/2021-05:47:12] [V] [TRT] Fastest Tactic: 0 Time: 0.013312 [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:12] [V] [TRT] Tactic: 4549827808004681195 Time: 0.014152 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:12] [V] [TRT] Tactic: 5779835512569528575 Time: 0.015684 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:47:12] [V] [TRT] Tactic: 9151672657204310840 Time: 0.025244 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:47:12] [V] [TRT] Tactic: -7491730084094677098 Time: 0.014372 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:47:12] [V] [TRT] Tactic: -6622064180404051845 Time: 0.021164 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:12] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0143 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:47:12] [V] [TRT] Tactic: -6273689210331812572 Time: 0.014976 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:47:12] [V] [TRT] Tactic: -4337126844824617177 Time: 0.013704 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:12] [V] [TRT] Tactic: -1123676555321336786 Time: 0.016032 [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:12] [V] [TRT] Tactic: -701551393537224327 Time: 0.014336 [05/21/2021-05:47:12] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.013704 [05/21/2021-05:47:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647 [05/21/2021-05:47:12] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:12] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:12] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:12] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014336 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:13] [V] [TRT] Tactic: 2860655430572478466 Time: 0.011576 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4474630279712975759 Time: 0.01024 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0096 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4696204239951173149 Time: 0.010996 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:13] [V] [TRT] Tactic: 5778138195697110003 Time: 0.014324 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:13] [V] [TRT] Tactic: 8918020581761223752 Time: 0.013512 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:13] [V] [TRT] Tactic: -5905193483742532701 Time: 0.011392 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:13] [V] [TRT] Tactic: -4035591156787122265 Time: 0.009772 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:13] [V] [TRT] Tactic: -2809379259463049391 Time: 0.01494 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:13] [V] [TRT] Tactic: -1985235291706575900 Time: 0.013952 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:13] [V] [TRT] Tactic: -504296718212024303 Time: 0.013852 [05/21/2021-05:47:13] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.0096 [05/21/2021-05:47:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:13] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:13] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:47:13] [V] [TRT] Tactic: 1373022415249282411 Time: 0.01344 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:13] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014384 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:13] [V] [TRT] Tactic: 2860655430572478466 Time: 0.011136 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4474630279712975759 Time: 0.009216 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4479823862704990365 Time: 0.009216 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:13] [V] [TRT] Tactic: 4696204239951173149 Time: 0.011136 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:13] [V] [TRT] Tactic: 5778138195697110003 Time: 0.01536 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:13] [V] [TRT] Tactic: 8918020581761223752 Time: 0.013952 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:47:13] [V] [TRT] Tactic: -7067026478815706014 Time: 0.013312 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:13] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0107 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:13] [V] [TRT] Tactic: -4035591156787122265 Time: 0.009508 [05/21/2021-05:47:13] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:14] [V] [TRT] Tactic: -2809379259463049391 Time: 0.014468 [05/21/2021-05:47:14] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:14] [V] [TRT] Tactic: -1985235291706575900 Time: 0.01408 [05/21/2021-05:47:14] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:14] [V] [TRT] Tactic: -504296718212024303 Time: 0.014184 [05/21/2021-05:47:14] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 0.009216 [05/21/2021-05:47:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759 [05/21/2021-05:47:14] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:14] [V] [TRT] Tactic: 0 Time: 0.014408 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1 Time: 0.014372 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2 Time: 0.032684 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4 Time: 0.370904 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5 Time: 0.031564 [05/21/2021-05:47:14] [V] [TRT] Tactic: 56 Time: 0.014356 [05/21/2021-05:47:14] [V] [TRT] Tactic: 58 Time: 0.035356 [05/21/2021-05:47:14] [V] [TRT] Tactic: 60 Time: 0.370648 [05/21/2021-05:47:14] [V] [TRT] Tactic: 61 Time: 0.032352 [05/21/2021-05:47:14] [V] [TRT] Fastest Tactic: 56 Time: 0.014356 [05/21/2021-05:47:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56 [05/21/2021-05:47:14] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:14] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:47:14] [V] [TRT] Tactic: 589823 Time: 0.014336 [05/21/2021-05:47:14] [V] [TRT] Tactic: 655359 Time: 0.011904 [05/21/2021-05:47:14] [V] [TRT] Tactic: 786431 Time: 0.009984 [05/21/2021-05:47:14] [V] [TRT] Tactic: 851967 Time: 0.011648 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1179647 Time: 0.00896 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1310719 Time: 0.011648 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1376255 Time: 0.013184 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1441791 Time: 0.00936 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1507327 Time: 0.010124 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1638399 Time: 0.009268 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1835007 Time: 0.009988 [05/21/2021-05:47:14] [V] [TRT] Tactic: 1900543 Time: 0.012312 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2097151 Time: 0.00934 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2162687 Time: 0.013312 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2293759 Time: 0.012756 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2359295 Time: 0.01024 [05/21/2021-05:47:14] [V] [TRT] Tactic: 2686975 Time: 0.012288 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3080191 Time: 0.009216 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3342335 Time: 0.009984 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3407871 Time: 0.009908 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3538943 Time: 0.009216 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3670015 Time: 0.016416 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3932159 Time: 0.011776 [05/21/2021-05:47:14] [V] [TRT] Tactic: 3997695 Time: 0.009856 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4063231 Time: 0.010112 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4194303 Time: 0.009624 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4259839 Time: 0.009648 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4325375 Time: 0.009516 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4521983 Time: 0.01288 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4587519 Time: 0.009744 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4653055 Time: 0.009452 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4915199 Time: 0.00896 [05/21/2021-05:47:14] [V] [TRT] Tactic: 4980735 Time: 0.009472 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5177343 Time: 0.008344 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5242879 Time: 0.009636 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5373951 Time: 0.009224 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5439487 Time: 0.0096 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5570559 Time: 0.009228 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5636095 Time: 0.009984 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5701631 Time: 0.012448 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5767167 Time: 0.01344 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5832703 Time: 0.009984 [05/21/2021-05:47:14] [V] [TRT] Tactic: 5898239 Time: 0.0094 [05/21/2021-05:47:14] [V] [TRT] Tactic: 6029311 Time: 0.012312 [05/21/2021-05:47:14] [V] [TRT] Tactic: 6225919 Time: 0.009476 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6291455 Time: 0.00922 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6422527 Time: 0.009652 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6750207 Time: 0.00936 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6815743 Time: 0.01024 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6946815 Time: 0.009728 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7012351 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7077887 Time: 0.008564 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7143423 Time: 0.01024 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7208959 Time: 0.010752 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7340031 Time: 0.009472 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7405567 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7536639 Time: 0.011716 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7602175 Time: 0.009224 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7733247 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7798783 Time: 0.00976 [05/21/2021-05:47:15] [V] [TRT] Tactic: 8191999 Time: 0.008788 [05/21/2021-05:47:15] [V] [TRT] Tactic: 8257535 Time: 0.0088 [05/21/2021-05:47:15] [V] [TRT] Tactic: 8323071 Time: 0.00926 [05/21/2021-05:47:15] [V] [TRT] Tactic: 8650751 Time: 0.009344 [05/21/2021-05:47:15] [V] [TRT] Tactic: 8716287 Time: 0.009244 [05/21/2021-05:47:15] [V] [TRT] Tactic: 9109503 Time: 0.009408 [05/21/2021-05:47:15] [V] [TRT] Tactic: 9568255 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] Tactic: 9895935 Time: 0.0095 [05/21/2021-05:47:15] [V] [TRT] Tactic: 10223615 Time: 0.012596 [05/21/2021-05:47:15] [V] [TRT] Tactic: 10354687 Time: 0.008704 [05/21/2021-05:47:15] [V] [TRT] Tactic: 10551295 Time: 0.01028 [05/21/2021-05:47:15] [V] [TRT] Tactic: 10747903 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] Tactic: 10944511 Time: 0.009552 [05/21/2021-05:47:15] [V] [TRT] Fastest Tactic: 5177343 Time: 0.008344 [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:15] [V] [TRT] Tactic: 2195670545862694453 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:15] [V] [TRT] Tactic: 3891805945559659536 Time: 0.012288 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:47:15] [V] [TRT] Tactic: 4418200634486186714 Time: 0.009748 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:15] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01024 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:15] [V] [TRT] Tactic: 6057304366605292508 Time: 0.00952 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:47:15] [V] [TRT] Tactic: 7392644644614664811 Time: 0.009472 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:47:15] [V] [TRT] Tactic: -4884039206922900293 Time: 0.011308 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:15] [V] [TRT] Tactic: -4374269919094467161 Time: 0.00974 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:15] [V] [TRT] Tactic: -1546027692247304867 Time: 0.011392 [05/21/2021-05:47:15] [V] [TRT] Fastest Tactic: 2195670545862694453 Time: 0.009216 [05/21/2021-05:47:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [05/21/2021-05:47:15] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:15] [V] [TRT] Tactic: 0 Time: 0.130784 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1 Time: 0.020828 [05/21/2021-05:47:15] [V] [TRT] Tactic: 2 Time: 0.03698 [05/21/2021-05:47:15] [V] [TRT] Tactic: 56 Time: 0.130176 [05/21/2021-05:47:15] [V] [TRT] Tactic: 58 Time: 0.0369 [05/21/2021-05:47:15] [V] [TRT] Fastest Tactic: 1 Time: 0.020828 [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:15] [V] [TRT] Tactic: 254850674756030979 Time: 0.010624 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1156328698016730421 Time: 0.008664 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1362727228442059924 Time: 0.008576 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1576319725282257846 Time: 0.00758 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1832046141070096030 Time: 0.007168 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:15] [V] [TRT] Tactic: 1838082074606840426 Time: 0.007556 [05/21/2021-05:47:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:16] [V] [TRT] Tactic: 1899296423087490472 Time: 0.00704 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:47:16] [V] [TRT] Tactic: 2238656696610018305 Time: 0.007288 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:16] [V] [TRT] Tactic: 2541579301352125276 Time: 0.00768 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:47:16] [V] [TRT] Tactic: 2559328254295148085 Time: 0.009076 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:16] [V] [TRT] Tactic: 2657157263811141609 Time: 0.006528 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:16] [V] [TRT] Tactic: 2968605903460894194 Time: 0.007816 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3071479995783211391 Time: 0.007508 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3359475309458902373 Time: 0.007848 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3362537467505018070 Time: 0.008704 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3513075359009385578 Time: 0.010344 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3704534001553878387 Time: 0.008264 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:47:16] [V] [TRT] Tactic: 3899310434460415852 Time: 0.006552 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4278315135102886928 Time: 0.007296 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4370476717970497892 Time: 0.007296 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007168 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01022 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00832 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4571819373777460444 Time: 0.009404 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0092 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4802447371470387646 Time: 0.008448 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:47:16] [V] [TRT] Tactic: 4993757826442493905 Time: 0.006236 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:16] [V] [TRT] Tactic: 5059676457552313631 Time: 0.010496 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:47:16] [V] [TRT] Tactic: 5205510332404400949 Time: 0.007856 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:47:16] [V] [TRT] Tactic: 5346855796032465921 Time: 0.008732 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:16] [V] [TRT] Tactic: 5398999388616959893 Time: 0.008576 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:16] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00704 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:16] [V] [TRT] Tactic: 6377497238381488891 Time: 0.008116 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:16] [V] [TRT] Tactic: 6468794451065529747 Time: 0.007552 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:47:16] [V] [TRT] Tactic: 6697277555581639516 Time: 0.006656 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:16] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0064 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:16] [V] [TRT] Tactic: 7216571380637776659 Time: 0.008192 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:16] [V] [TRT] Tactic: 7609923741161019135 Time: 0.006576 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:16] [V] [TRT] Tactic: 8101703987960976805 Time: 0.007168 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:16] [V] [TRT] Tactic: 8170606396342855895 Time: 0.008192 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:47:16] [V] [TRT] Tactic: 8764780417487154889 Time: 0.008704 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:47:16] [V] [TRT] Tactic: 8823554289762712606 Time: 0.006656 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:16] [V] [TRT] Tactic: 8839784824303350101 Time: 0.00832 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:47:16] [V] [TRT] Tactic: -9203179519031456182 Time: 0.006144 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:16] [V] [TRT] Tactic: -9009272790678027912 Time: 0.008576 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:16] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0064 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:47:16] [V] [TRT] Tactic: -8280443484414412687 Time: 0.009764 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:47:16] [V] [TRT] Tactic: -8205952393017864204 Time: 0.009924 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:47:16] [V] [TRT] Tactic: -8131857373260504832 Time: 0.007296 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:47:16] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0064 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:47:16] [V] [TRT] Tactic: -7099920365135295801 Time: 0.006388 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:47:16] [V] [TRT] Tactic: -7089118800560870395 Time: 0.006144 [05/21/2021-05:47:16] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:47:17] [V] [TRT] Tactic: -6768327495007644783 Time: 0.007216 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:17] [V] [TRT] Tactic: -6356316196810535311 Time: 0.007552 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:17] [V] [TRT] Tactic: -6063766379489217211 Time: 0.00704 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:17] [V] [TRT] Tactic: -5530886555766748586 Time: 0.007936 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:47:17] [V] [TRT] Tactic: -5409588854490562130 Time: 0.006272 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:17] [V] [TRT] Tactic: -5161596964442251102 Time: 0.007872 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:17] [V] [TRT] Tactic: -5127240325355316006 Time: 0.007152 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00642 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4796511246675321840 Time: 0.007864 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4548822885169694805 Time: 0.006912 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00692 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4293222705763522367 Time: 0.006164 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4152066959007262150 Time: 0.009576 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:17] [V] [TRT] Tactic: -4021926646879732549 Time: 0.007296 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3987638434926559037 Time: 0.007908 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3905653247016903130 Time: 0.008776 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3903342530518878192 Time: 0.008192 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3864869056275745423 Time: 0.008324 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3601464762214218301 Time: 0.006276 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:17] [V] [TRT] Tactic: -3058330359340425555 Time: 0.007944 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:47:17] [V] [TRT] Tactic: -2878731503146438856 Time: 0.008836 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:47:17] [V] [TRT] Tactic: -2602982885923184927 Time: 0.007324 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:47:17] [V] [TRT] Tactic: -2353603993968373338 Time: 0.008192 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:47:17] [V] [TRT] Tactic: -2032577876140256150 Time: 0.007168 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:47:17] [V] [TRT] Tactic: -2003055242756584050 Time: 0.006272 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1985778916402815946 Time: 0.00896 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00744 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1640527254204634147 Time: 0.00776 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1562548049711204899 Time: 0.00896 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1242202084391243207 Time: 0.007328 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1099247066487349374 Time: 0.006968 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:47:17] [V] [TRT] Tactic: -1038291877007553549 Time: 0.007168 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:47:17] [V] [TRT] Tactic: -406984317033388136 Time: 0.008408 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:47:17] [V] [TRT] Tactic: -331499326992534460 Time: 0.007116 [05/21/2021-05:47:17] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:47:17] [V] [TRT] Tactic: -206523504474952360 Time: 0.008832 [05/21/2021-05:47:17] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.006144 [05/21/2021-05:47:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182 [05/21/2021-05:47:17] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:17] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:47:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:47:17] [V] [TRT] Tactic: 524287 Time: 0.03482 [05/21/2021-05:47:17] [V] [TRT] Tactic: 720895 Time: 0.030736 [05/21/2021-05:47:17] [V] [TRT] Tactic: 983039 Time: 0.023552 [05/21/2021-05:47:17] [V] [TRT] Tactic: 1048575 Time: 0.03052 [05/21/2021-05:47:17] [V] [TRT] Tactic: 1703935 Time: 0.02334 [05/21/2021-05:47:17] [V] [TRT] Tactic: 1769471 Time: 0.031232 [05/21/2021-05:47:17] [V] [TRT] Tactic: 1966079 Time: 0.055848 [05/21/2021-05:47:17] [V] [TRT] Tactic: 2031615 Time: 0.046336 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2228223 Time: 0.029056 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2424831 Time: 0.026496 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2621439 Time: 0.024576 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2752511 Time: 0.0341 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2818047 Time: 0.045056 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2883583 Time: 0.05994 [05/21/2021-05:47:18] [V] [TRT] Tactic: 3014655 Time: 0.022656 [05/21/2021-05:47:18] [V] [TRT] Tactic: 3145727 Time: 0.026624 [05/21/2021-05:47:18] [V] [TRT] Tactic: 3473407 Time: 0.049788 [05/21/2021-05:47:18] [V] [TRT] Tactic: 3604479 Time: 0.023808 [05/21/2021-05:47:18] [V] [TRT] Tactic: 3735551 Time: 0.040144 [05/21/2021-05:47:18] [V] [TRT] Tactic: 4390911 Time: 0.055296 [05/21/2021-05:47:18] [V] [TRT] Tactic: 5046271 Time: 0.02798 [05/21/2021-05:47:18] [V] [TRT] Tactic: 5963775 Time: 0.047104 [05/21/2021-05:47:18] [V] [TRT] Tactic: 6160383 Time: 0.032768 [05/21/2021-05:47:18] [V] [TRT] Tactic: 6488063 Time: 0.029568 [05/21/2021-05:47:18] [V] [TRT] Tactic: 6881279 Time: 0.04096 [05/21/2021-05:47:18] [V] [TRT] Tactic: 7274495 Time: 0.021532 [05/21/2021-05:47:18] [V] [TRT] Tactic: 7864319 Time: 0.021288 [05/21/2021-05:47:18] [V] [TRT] Tactic: 7995391 Time: 0.033664 [05/21/2021-05:47:18] [V] [TRT] Tactic: 8585215 Time: 0.039168 [05/21/2021-05:47:18] [V] [TRT] Tactic: 8847359 Time: 0.026 [05/21/2021-05:47:18] [V] [TRT] Tactic: 8978431 Time: 0.048512 [05/21/2021-05:47:18] [V] [TRT] Tactic: 9043967 Time: 0.023836 [05/21/2021-05:47:18] [V] [TRT] Tactic: 9175039 Time: 0.023808 [05/21/2021-05:47:18] [V] [TRT] Tactic: 9502719 Time: 0.054408 [05/21/2021-05:47:18] [V] [TRT] Tactic: 9830399 Time: 0.037936 [05/21/2021-05:47:18] [V] [TRT] Tactic: 9961471 Time: 0.029312 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10027007 Time: 0.030984 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10092543 Time: 0.05558 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10289151 Time: 0.054304 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10485759 Time: 0.022528 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10682367 Time: 0.023168 [05/21/2021-05:47:18] [V] [TRT] Tactic: 10813439 Time: 0.025372 [05/21/2021-05:47:18] [V] [TRT] Fastest Tactic: 7864319 Time: 0.021288 [05/21/2021-05:47:18] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:18] [V] [TRT] Tactic: 0 Time: 0.040536 [05/21/2021-05:47:18] [V] [TRT] Tactic: 1 Time: 0.02864 [05/21/2021-05:47:18] [V] [TRT] Tactic: 2 Time: 0.089264 [05/21/2021-05:47:18] [V] [TRT] Tactic: 4 Time: 0.373488 [05/21/2021-05:47:18] [V] [TRT] Tactic: 5 Time: 0.168372 [05/21/2021-05:47:18] [V] [TRT] Tactic: 6 Time: 0.02474 [05/21/2021-05:47:18] [V] [TRT] Tactic: 56 Time: 0.041264 [05/21/2021-05:47:18] [V] [TRT] Tactic: 57 Time: 0.031052 [05/21/2021-05:47:18] [V] [TRT] Tactic: 58 Time: 0.089332 [05/21/2021-05:47:18] [V] [TRT] Tactic: 60 Time: 0.372696 [05/21/2021-05:47:19] [V] [TRT] Tactic: 61 Time: 0.16826 [05/21/2021-05:47:19] [V] [TRT] Tactic: 62 Time: 0.024612 [05/21/2021-05:47:19] [V] [TRT] Tactic: 112 Time: 0.040764 [05/21/2021-05:47:19] [V] [TRT] Tactic: 113 Time: 0.04038 [05/21/2021-05:47:19] [V] [TRT] Tactic: 114 Time: 0.089152 [05/21/2021-05:47:19] [V] [TRT] Tactic: 116 Time: 0.372052 [05/21/2021-05:47:19] [V] [TRT] Tactic: 117 Time: 0.167484 [05/21/2021-05:47:19] [V] [TRT] Tactic: 118 Time: 0.024596 [05/21/2021-05:47:19] [V] [TRT] Fastest Tactic: 118 Time: 0.024596 [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4549827808004681195 Time: 0.05504 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:19] [V] [TRT] Tactic: 5779835512569528575 Time: 0.068992 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:47:19] [V] [TRT] Tactic: 6053873026024413720 Time: 0.070664 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:47:19] [V] [TRT] Tactic: 6767548733843469815 Time: 0.056576 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:19] [V] [TRT] Tactic: -6313876406580483184 Time: 0.069632 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:19] [V] [TRT] Tactic: -1123676555321336786 Time: 0.071048 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:19] [V] [TRT] Tactic: -701551393537224327 Time: 0.06044 [05/21/2021-05:47:19] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.05504 [05/21/2021-05:47:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319 [05/21/2021-05:47:19] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:19] [V] [TRT] Tactic: 2860655430572478466 Time: 0.04262 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026248 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025856 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4696204239951173149 Time: 0.042752 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:19] [V] [TRT] Tactic: 5778138195697110003 Time: 0.069272 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:47:19] [V] [TRT] Tactic: 7155825427510256858 Time: 0.06784 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:19] [V] [TRT] Tactic: 8918020581761223752 Time: 0.065712 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:47:19] [V] [TRT] Tactic: -4756382386362004279 Time: 0.041844 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:19] [V] [TRT] Tactic: -3855385237722507464 Time: 0.070704 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:19] [V] [TRT] Tactic: -2809379259463049391 Time: 0.069772 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:19] [V] [TRT] Tactic: -504296718212024303 Time: 0.067456 [05/21/2021-05:47:19] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.025856 [05/21/2021-05:47:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:19] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:19] [V] [TRT] Tactic: 2860655430572478466 Time: 0.042468 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026388 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025984 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:19] [V] [TRT] Tactic: 4696204239951173149 Time: 0.042624 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:19] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06912 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:47:19] [V] [TRT] Tactic: 7155825427510256858 Time: 0.06784 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:47:19] [V] [TRT] Tactic: 7342025736444949634 Time: 0.047864 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:19] [V] [TRT] Tactic: 8918020581761223752 Time: 0.066192 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:47:19] [V] [TRT] Tactic: -7377458734869418330 Time: 0.049808 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:47:19] [V] [TRT] Tactic: -5457304872213719461 Time: 0.05018 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:47:19] [V] [TRT] Tactic: -4756382386362004279 Time: 0.042112 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:19] [V] [TRT] Tactic: -3855385237722507464 Time: 0.069888 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:19] [V] [TRT] Tactic: -2809379259463049391 Time: 0.06848 [05/21/2021-05:47:19] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:19] [V] [TRT] Tactic: -504296718212024303 Time: 0.066688 [05/21/2021-05:47:19] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.025984 [05/21/2021-05:47:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:19] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:19] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:19] [V] [TRT] Tactic: 0 Time: 0.04726 [05/21/2021-05:47:19] [V] [TRT] Tactic: 1 Time: 0.047104 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2 Time: 0.078464 [05/21/2021-05:47:20] [V] [TRT] Tactic: 4 Time: 0.369736 [05/21/2021-05:47:20] [V] [TRT] Tactic: 5 Time: 0.1657 [05/21/2021-05:47:20] [V] [TRT] Tactic: 6 Time: 0.04032 [05/21/2021-05:47:20] [V] [TRT] Tactic: 56 Time: 0.0471 [05/21/2021-05:47:20] [V] [TRT] Tactic: 58 Time: 0.074196 [05/21/2021-05:47:20] [V] [TRT] Tactic: 60 Time: 0.369576 [05/21/2021-05:47:20] [V] [TRT] Tactic: 61 Time: 0.163104 [05/21/2021-05:47:20] [V] [TRT] Tactic: 62 Time: 0.039768 [05/21/2021-05:47:20] [V] [TRT] Fastest Tactic: 62 Time: 0.039768 [05/21/2021-05:47:20] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62 [05/21/2021-05:47:20] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:20] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:47:20] [V] [TRT] Tactic: 524287 Time: 0.02492 [05/21/2021-05:47:20] [V] [TRT] Tactic: 720895 Time: 0.022016 [05/21/2021-05:47:20] [V] [TRT] Tactic: 983039 Time: 0.017408 [05/21/2021-05:47:20] [V] [TRT] Tactic: 1048575 Time: 0.023424 [05/21/2021-05:47:20] [V] [TRT] Tactic: 1703935 Time: 0.01796 [05/21/2021-05:47:20] [V] [TRT] Tactic: 1769471 Time: 0.021796 [05/21/2021-05:47:20] [V] [TRT] Tactic: 1966079 Time: 0.034816 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2031615 Time: 0.030808 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2228223 Time: 0.019192 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2424831 Time: 0.018944 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2621439 Time: 0.018304 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2752511 Time: 0.02368 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2818047 Time: 0.031232 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2883583 Time: 0.041132 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3014655 Time: 0.01752 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3145727 Time: 0.020224 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3473407 Time: 0.034924 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3604479 Time: 0.017288 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3735551 Time: 0.029588 [05/21/2021-05:47:20] [V] [TRT] Tactic: 4390911 Time: 0.036224 [05/21/2021-05:47:20] [V] [TRT] Tactic: 5046271 Time: 0.018452 [05/21/2021-05:47:20] [V] [TRT] Tactic: 5963775 Time: 0.0318 [05/21/2021-05:47:20] [V] [TRT] Tactic: 6160383 Time: 0.021632 [05/21/2021-05:47:20] [V] [TRT] Tactic: 6488063 Time: 0.020224 [05/21/2021-05:47:20] [V] [TRT] Tactic: 6881279 Time: 0.027648 [05/21/2021-05:47:20] [V] [TRT] Tactic: 7274495 Time: 0.01554 [05/21/2021-05:47:20] [V] [TRT] Tactic: 7864319 Time: 0.015472 [05/21/2021-05:47:20] [V] [TRT] Tactic: 7995391 Time: 0.022544 [05/21/2021-05:47:20] [V] [TRT] Tactic: 8585215 Time: 0.026648 [05/21/2021-05:47:20] [V] [TRT] Tactic: 8847359 Time: 0.015584 [05/21/2021-05:47:20] [V] [TRT] Tactic: 8978431 Time: 0.031916 [05/21/2021-05:47:20] [V] [TRT] Tactic: 9043967 Time: 0.01616 [05/21/2021-05:47:20] [V] [TRT] Tactic: 9175039 Time: 0.017172 [05/21/2021-05:47:20] [V] [TRT] Tactic: 9502719 Time: 0.036908 [05/21/2021-05:47:20] [V] [TRT] Tactic: 9830399 Time: 0.027536 [05/21/2021-05:47:20] [V] [TRT] Tactic: 9961471 Time: 0.019712 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10027007 Time: 0.021656 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10092543 Time: 0.03712 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10289151 Time: 0.034376 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10485759 Time: 0.01642 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10682367 Time: 0.017408 [05/21/2021-05:47:20] [V] [TRT] Tactic: 10813439 Time: 0.019072 [05/21/2021-05:47:20] [V] [TRT] Fastest Tactic: 7864319 Time: 0.015472 [05/21/2021-05:47:20] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:20] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:20] [V] [TRT] Tactic: 2195670545862694453 Time: 0.034816 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3419182076704469245 Time: 0.0338 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:20] [V] [TRT] Tactic: 3891805945559659536 Time: 0.047616 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:20] [V] [TRT] Tactic: 5548126322150286555 Time: 0.033792 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:20] [V] [TRT] Tactic: 6057304366605292508 Time: 0.030468 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:47:20] [V] [TRT] Tactic: -7928611605886347652 Time: 0.048124 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:47:20] [V] [TRT] Tactic: -5172391392092686714 Time: 0.037416 [05/21/2021-05:47:20] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:21] [V] [TRT] Tactic: -4374269919094467161 Time: 0.03072 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953 [05/21/2021-05:47:21] [V] [TRT] Tactic: -4083394051665370953 Time: 0.011292 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:21] [V] [TRT] Tactic: -1546027692247304867 Time: 0.046636 [05/21/2021-05:47:21] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.011292 [05/21/2021-05:47:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [05/21/2021-05:47:21] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:21] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:21] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:21] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:21] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:21] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:47:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:21] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:21] [V] [TRT] Tactic: 0 Time: 0.953992 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1 Time: 0.111116 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2 Time: 0.11956 [05/21/2021-05:47:21] [V] [TRT] Tactic: 6 Time: 0.0352 [05/21/2021-05:47:21] [V] [TRT] Tactic: 56 Time: 0.959232 [05/21/2021-05:47:21] [V] [TRT] Tactic: 58 Time: 0.119936 [05/21/2021-05:47:21] [V] [TRT] Tactic: 62 Time: 0.033664 [05/21/2021-05:47:21] [V] [TRT] Fastest Tactic: 62 Time: 0.033664 [05/21/2021-05:47:21] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:21] [V] [TRT] Tactic: 254850674756030979 Time: 0.02794 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:47:21] [V] [TRT] Tactic: 328038211831149625 Time: 0.027612 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:47:21] [V] [TRT] Tactic: 411553864378931917 Time: 0.012032 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1011057357468998345 Time: 0.018048 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1156328698016730421 Time: 0.018176 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1723736032573714698 Time: 0.011304 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011328 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011264 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:21] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009216 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2428167804343994714 Time: 0.010868 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2541579301352125276 Time: 0.017024 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2657157263811141609 Time: 0.010112 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2819719497590964443 Time: 0.012544 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2968605903460894194 Time: 0.012288 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:47:21] [V] [TRT] Tactic: 2986078304285316765 Time: 0.01728 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:21] [V] [TRT] Tactic: 3362537467505018070 Time: 0.017024 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:21] [V] [TRT] Tactic: 3513075359009385578 Time: 0.028276 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:47:21] [V] [TRT] Tactic: 3573559043797674382 Time: 0.01242 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:47:21] [V] [TRT] Tactic: 3591970081995419777 Time: 0.009856 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:21] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016756 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:21] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01126 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:47:21] [V] [TRT] Tactic: 4503233883285355107 Time: 0.009208 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:21] [V] [TRT] Tactic: 4802447371470387646 Time: 0.018572 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5059676457552313631 Time: 0.027776 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5368829646735632944 Time: 0.009472 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5398999388616959893 Time: 0.018064 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5746691132547383910 Time: 0.012288 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5770170567977052602 Time: 0.020396 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:47:21] [V] [TRT] Tactic: 5953552212833506549 Time: 0.017948 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:21] [V] [TRT] Tactic: 6034364043891107501 Time: 0.011604 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:47:21] [V] [TRT] Tactic: 6074229447555668232 Time: 0.009472 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:47:21] [V] [TRT] Tactic: 6154447660803990543 Time: 0.012288 [05/21/2021-05:47:21] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6325769668000961702 Time: 0.016384 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6350273239113254096 Time: 0.013348 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6377497238381488891 Time: 0.016376 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6446388116965632819 Time: 0.01244 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0123 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6642277870194067185 Time: 0.028672 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009112 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6972489290272968208 Time: 0.017152 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:47:22] [V] [TRT] Tactic: 6979044990896381511 Time: 0.027312 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:22] [V] [TRT] Tactic: 7216571380637776659 Time: 0.019456 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:22] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011264 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:47:22] [V] [TRT] Tactic: 7705739241028240201 Time: 0.00964 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:47:22] [V] [TRT] Tactic: 8072087735545283117 Time: 0.027264 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:22] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009396 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:22] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011904 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:22] [V] [TRT] Tactic: 8839784824303350101 Time: 0.017908 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:47:22] [V] [TRT] Tactic: -9217371357561775773 Time: 0.010604 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:22] [V] [TRT] Tactic: -9009272790678027912 Time: 0.02 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:47:22] [V] [TRT] Tactic: -8985224497679592364 Time: 0.00926 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:47:22] [V] [TRT] Tactic: -8949544755481315679 Time: 0.01228 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:47:22] [V] [TRT] Tactic: -8759929675070720385 Time: 0.01728 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:22] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00926 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013972 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6840588038605932325 Time: 0.011712 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6799856376604253964 Time: 0.027404 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6625722781282978136 Time: 0.011348 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6525498856028268801 Time: 0.016356 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0096 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6324345858751792783 Time: 0.012948 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6262400699544994312 Time: 0.027008 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6257787336162086472 Time: 0.018356 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:22] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0114 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5777580938094193096 Time: 0.01158 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5657273398217409378 Time: 0.027776 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016512 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5422685219138380548 Time: 0.011408 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011776 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:22] [V] [TRT] Tactic: -5127240325355316006 Time: 0.011264 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:47:22] [V] [TRT] Tactic: -4825567853927730435 Time: 0.010496 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:22] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011688 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:47:22] [V] [TRT] Tactic: -4706569565442112734 Time: 0.009632 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:47:22] [V] [TRT] Tactic: -4566599693570369588 Time: 0.016352 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:47:22] [V] [TRT] Tactic: -4409144516525410768 Time: 0.016384 [05/21/2021-05:47:22] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:23] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011316 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:23] [V] [TRT] Tactic: -4152066959007262150 Time: 0.027804 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:23] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011392 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3987638434926559037 Time: 0.01216 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01822 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3903974568488493144 Time: 0.011256 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3895429239811098010 Time: 0.01152 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3864869056275745423 Time: 0.018884 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3601464762214218301 Time: 0.009088 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3412636942650049698 Time: 0.018432 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3338665856053412950 Time: 0.01792 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:23] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011656 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2816084650627734155 Time: 0.020256 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2662892962457732243 Time: 0.01024 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2559894581585337900 Time: 0.027008 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2530740716768816092 Time: 0.015532 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2332828394978346992 Time: 0.016384 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2241736083352441442 Time: 0.019988 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:47:23] [V] [TRT] Tactic: -2161909437867201546 Time: 0.01344 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:23] [V] [TRT] Tactic: -1985778916402815946 Time: 0.019472 [05/21/2021-05:47:23] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:47:24] [V] [TRT] Tactic: -1500496213132463076 Time: 0.01242 [05/21/2021-05:47:24] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:24] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009216 [05/21/2021-05:47:24] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:47:24] [V] [TRT] Tactic: -910286698936744682 Time: 0.00908 [05/21/2021-05:47:24] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:47:24] [V] [TRT] Tactic: -606726295133751039 Time: 0.010336 [05/21/2021-05:47:24] [V] [TRT] Fastest Tactic: -910286698936744682 Time: 0.00908 [05/21/2021-05:47:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -910286698936744682 [05/21/2021-05:47:24] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:24] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:24] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:24] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:24] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:24] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:47:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:24] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:47:24] [V] [TRT] Tactic: 589823 Time: 0.041472 [05/21/2021-05:47:24] [V] [TRT] Tactic: 655359 Time: 0.0384 [05/21/2021-05:47:24] [V] [TRT] Tactic: 786431 Time: 0.03666 [05/21/2021-05:47:24] [V] [TRT] Tactic: 851967 Time: 0.03538 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1179647 Time: 0.035712 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1310719 Time: 0.034612 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1376255 Time: 0.036608 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1441791 Time: 0.03712 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1507327 Time: 0.036492 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1638399 Time: 0.035852 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1835007 Time: 0.039168 [05/21/2021-05:47:24] [V] [TRT] Tactic: 1900543 Time: 0.0401 [05/21/2021-05:47:24] [V] [TRT] Tactic: 2097151 Time: 0.036352 [05/21/2021-05:47:24] [V] [TRT] Tactic: 2162687 Time: 0.0384 [05/21/2021-05:47:24] [V] [TRT] Tactic: 2293759 Time: 0.0382 [05/21/2021-05:47:24] [V] [TRT] Tactic: 2359295 Time: 0.035328 [05/21/2021-05:47:24] [V] [TRT] Tactic: 2686975 Time: 0.035876 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3080191 Time: 0.033664 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3342335 Time: 0.035848 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3407871 Time: 0.034816 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3538943 Time: 0.034208 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3670015 Time: 0.045508 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3932159 Time: 0.03704 [05/21/2021-05:47:24] [V] [TRT] Tactic: 3997695 Time: 0.036024 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4063231 Time: 0.036224 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4194303 Time: 0.036512 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4259839 Time: 0.035368 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4325375 Time: 0.034204 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4521983 Time: 0.036736 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4587519 Time: 0.034336 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4653055 Time: 0.0342 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4915199 Time: 0.03546 [05/21/2021-05:47:24] [V] [TRT] Tactic: 4980735 Time: 0.035628 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5177343 Time: 0.03728 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5242879 Time: 0.033608 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5373951 Time: 0.03998 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5439487 Time: 0.040832 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5570559 Time: 0.034068 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5636095 Time: 0.035072 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5701631 Time: 0.035712 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5767167 Time: 0.06748 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5832703 Time: 0.032768 [05/21/2021-05:47:24] [V] [TRT] Tactic: 5898239 Time: 0.034832 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6029311 Time: 0.036652 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6225919 Time: 0.03484 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6291455 Time: 0.035712 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6422527 Time: 0.033408 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6750207 Time: 0.038792 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6815743 Time: 0.036096 [05/21/2021-05:47:24] [V] [TRT] Tactic: 6946815 Time: 0.040664 [05/21/2021-05:47:24] [V] [TRT] Tactic: 7012351 Time: 0.036504 [05/21/2021-05:47:24] [V] [TRT] Tactic: 7077887 Time: 0.034316 [05/21/2021-05:47:24] [V] [TRT] Tactic: 7143423 Time: 0.048116 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7208959 Time: 0.034188 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7340031 Time: 0.036416 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7405567 Time: 0.034944 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7536639 Time: 0.04536 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7602175 Time: 0.03584 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7733247 Time: 0.035492 [05/21/2021-05:47:25] [V] [TRT] Tactic: 7798783 Time: 0.0355 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8191999 Time: 0.03776 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8257535 Time: 0.035404 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8323071 Time: 0.035888 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8650751 Time: 0.03648 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8716287 Time: 0.03688 [05/21/2021-05:47:25] [V] [TRT] Tactic: 9109503 Time: 0.035968 [05/21/2021-05:47:25] [V] [TRT] Tactic: 9568255 Time: 0.035072 [05/21/2021-05:47:25] [V] [TRT] Tactic: 9895935 Time: 0.036352 [05/21/2021-05:47:25] [V] [TRT] Tactic: 10223615 Time: 0.037888 [05/21/2021-05:47:25] [V] [TRT] Tactic: 10354687 Time: 0.036108 [05/21/2021-05:47:25] [V] [TRT] Tactic: 10551295 Time: 0.043668 [05/21/2021-05:47:25] [V] [TRT] Tactic: 10747903 Time: 0.034904 [05/21/2021-05:47:25] [V] [TRT] Tactic: 10944511 Time: 0.035584 [05/21/2021-05:47:25] [V] [TRT] Fastest Tactic: 5832703 Time: 0.032768 [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:25] [V] [TRT] Tactic: 0 Time: 0.018588 [05/21/2021-05:47:25] [V] [TRT] Tactic: 1 Time: 0.018864 [05/21/2021-05:47:25] [V] [TRT] Tactic: 2 Time: 0.0448 [05/21/2021-05:47:25] [V] [TRT] Tactic: 4 Time: 1.36046 [05/21/2021-05:47:25] [V] [TRT] Tactic: 5 Time: 0.046636 [05/21/2021-05:47:25] [V] [TRT] Tactic: 56 Time: 0.018584 [05/21/2021-05:47:25] [V] [TRT] Tactic: 57 Time: 0.018432 [05/21/2021-05:47:25] [V] [TRT] Tactic: 58 Time: 0.044584 [05/21/2021-05:47:25] [V] [TRT] Tactic: 60 Time: 1.3606 [05/21/2021-05:47:25] [V] [TRT] Tactic: 61 Time: 0.045912 [05/21/2021-05:47:25] [V] [TRT] Tactic: 112 Time: 0.018308 [05/21/2021-05:47:25] [V] [TRT] Tactic: 113 Time: 0.01776 [05/21/2021-05:47:25] [V] [TRT] Tactic: 114 Time: 0.036444 [05/21/2021-05:47:25] [V] [TRT] Tactic: 116 Time: 1.36228 [05/21/2021-05:47:25] [V] [TRT] Tactic: 117 Time: 0.046288 [05/21/2021-05:47:25] [V] [TRT] Fastest Tactic: 113 Time: 0.01776 [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:25] [V] [TRT] Tactic: 4549827808004681195 Time: 0.01732 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:25] [V] [TRT] Tactic: 5779835512569528575 Time: 0.016384 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:47:25] [V] [TRT] Tactic: 9151672657204310840 Time: 0.028584 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:47:25] [V] [TRT] Tactic: -7491730084094677098 Time: 0.01758 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:47:25] [V] [TRT] Tactic: -6622064180404051845 Time: 0.030104 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:25] [V] [TRT] Tactic: -6313876406580483184 Time: 0.018432 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:47:25] [V] [TRT] Tactic: -6273689210331812572 Time: 0.016188 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:47:25] [V] [TRT] Tactic: -4337126844824617177 Time: 0.016384 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:25] [V] [TRT] Tactic: -1123676555321336786 Time: 0.016256 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:25] [V] [TRT] Tactic: -701551393537224327 Time: 0.017436 [05/21/2021-05:47:25] [V] [TRT] Fastest Tactic: -6273689210331812572 Time: 0.016188 [05/21/2021-05:47:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6273689210331812572 [05/21/2021-05:47:25] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:25] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:25] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:25] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014336 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:25] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015684 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:25] [V] [TRT] Tactic: 4474630279712975759 Time: 0.016384 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:25] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016512 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:25] [V] [TRT] Tactic: 4696204239951173149 Time: 0.016692 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:25] [V] [TRT] Tactic: 5778138195697110003 Time: 0.015624 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:25] [V] [TRT] Tactic: 8918020581761223752 Time: 0.015152 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:25] [V] [TRT] Tactic: -5905193483742532701 Time: 0.015488 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:25] [V] [TRT] Tactic: -4035591156787122265 Time: 0.017152 [05/21/2021-05:47:25] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:26] [V] [TRT] Tactic: -2809379259463049391 Time: 0.01538 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:26] [V] [TRT] Tactic: -1985235291706575900 Time: 0.014976 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:26] [V] [TRT] Tactic: -504296718212024303 Time: 0.01472 [05/21/2021-05:47:26] [V] [TRT] Fastest Tactic: 1663866669559596164 Time: 0.014336 [05/21/2021-05:47:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1663866669559596164 [05/21/2021-05:47:26] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1373022415249282411 Time: 0.015488 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1663866669559596164 Time: 0.01554 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015576 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4474630279712975759 Time: 0.016768 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016384 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4696204239951173149 Time: 0.015616 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:26] [V] [TRT] Tactic: 5778138195697110003 Time: 0.016 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:26] [V] [TRT] Tactic: 8918020581761223752 Time: 0.015104 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:47:26] [V] [TRT] Tactic: -7067026478815706014 Time: 0.016128 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:26] [V] [TRT] Tactic: -5905193483742532701 Time: 0.015536 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:26] [V] [TRT] Tactic: -4035591156787122265 Time: 0.017152 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:26] [V] [TRT] Tactic: -2809379259463049391 Time: 0.015532 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:26] [V] [TRT] Tactic: -1985235291706575900 Time: 0.014876 [05/21/2021-05:47:26] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:26] [V] [TRT] Tactic: -504296718212024303 Time: 0.014976 [05/21/2021-05:47:26] [V] [TRT] Fastest Tactic: -1985235291706575900 Time: 0.014876 [05/21/2021-05:47:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1985235291706575900 [05/21/2021-05:47:26] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:26] [V] [TRT] Tactic: 0 Time: 0.016528 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1 Time: 0.016436 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2 Time: 0.033988 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4 Time: 1.36126 [05/21/2021-05:47:26] [V] [TRT] Tactic: 5 Time: 0.045944 [05/21/2021-05:47:26] [V] [TRT] Tactic: 56 Time: 0.016416 [05/21/2021-05:47:26] [V] [TRT] Tactic: 58 Time: 0.033924 [05/21/2021-05:47:26] [V] [TRT] Tactic: 60 Time: 1.3615 [05/21/2021-05:47:26] [V] [TRT] Tactic: 61 Time: 0.045912 [05/21/2021-05:47:26] [V] [TRT] Fastest Tactic: 56 Time: 0.016416 [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56 [05/21/2021-05:47:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:26] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:47:26] [V] [TRT] Tactic: 589823 Time: 0.021936 [05/21/2021-05:47:26] [V] [TRT] Tactic: 655359 Time: 0.021376 [05/21/2021-05:47:26] [V] [TRT] Tactic: 786431 Time: 0.02112 [05/21/2021-05:47:26] [V] [TRT] Tactic: 851967 Time: 0.020488 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1179647 Time: 0.019524 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1310719 Time: 0.019464 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1376255 Time: 0.022016 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1441791 Time: 0.01984 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1507327 Time: 0.02112 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1638399 Time: 0.020608 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1835007 Time: 0.021852 [05/21/2021-05:47:26] [V] [TRT] Tactic: 1900543 Time: 0.023552 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2097151 Time: 0.021524 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2162687 Time: 0.021888 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2293759 Time: 0.021632 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2359295 Time: 0.019712 [05/21/2021-05:47:26] [V] [TRT] Tactic: 2686975 Time: 0.021504 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3080191 Time: 0.02018 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3342335 Time: 0.02112 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3407871 Time: 0.019456 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3538943 Time: 0.01924 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3670015 Time: 0.026112 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3932159 Time: 0.020864 [05/21/2021-05:47:26] [V] [TRT] Tactic: 3997695 Time: 0.02048 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4063231 Time: 0.020812 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4194303 Time: 0.019616 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4259839 Time: 0.02066 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4325375 Time: 0.019876 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4521983 Time: 0.021928 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4587519 Time: 0.019636 [05/21/2021-05:47:26] [V] [TRT] Tactic: 4653055 Time: 0.02048 [05/21/2021-05:47:27] [V] [TRT] Tactic: 4915199 Time: 0.020088 [05/21/2021-05:47:27] [V] [TRT] Tactic: 4980735 Time: 0.020396 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5177343 Time: 0.020992 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5242879 Time: 0.019248 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5373951 Time: 0.022684 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5439487 Time: 0.023424 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5570559 Time: 0.02048 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5636095 Time: 0.02142 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5701631 Time: 0.020492 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5767167 Time: 0.03816 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5832703 Time: 0.0192 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5898239 Time: 0.019712 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6029311 Time: 0.019708 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6225919 Time: 0.018688 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6291455 Time: 0.01984 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6422527 Time: 0.01856 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6750207 Time: 0.021504 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6815743 Time: 0.020264 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6946815 Time: 0.023832 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7012351 Time: 0.021504 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7077887 Time: 0.018816 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7143423 Time: 0.02694 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7208959 Time: 0.019456 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7340031 Time: 0.02048 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7405567 Time: 0.019964 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7536639 Time: 0.025208 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7602175 Time: 0.020224 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7733247 Time: 0.019456 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7798783 Time: 0.021248 [05/21/2021-05:47:27] [V] [TRT] Tactic: 8191999 Time: 0.020864 [05/21/2021-05:47:27] [V] [TRT] Tactic: 8257535 Time: 0.019732 [05/21/2021-05:47:27] [V] [TRT] Tactic: 8323071 Time: 0.020852 [05/21/2021-05:47:27] [V] [TRT] Tactic: 8650751 Time: 0.021012 [05/21/2021-05:47:27] [V] [TRT] Tactic: 8716287 Time: 0.020524 [05/21/2021-05:47:27] [V] [TRT] Tactic: 9109503 Time: 0.021788 [05/21/2021-05:47:27] [V] [TRT] Tactic: 9568255 Time: 0.020224 [05/21/2021-05:47:27] [V] [TRT] Tactic: 9895935 Time: 0.020608 [05/21/2021-05:47:27] [V] [TRT] Tactic: 10223615 Time: 0.02152 [05/21/2021-05:47:27] [V] [TRT] Tactic: 10354687 Time: 0.019712 [05/21/2021-05:47:27] [V] [TRT] Tactic: 10551295 Time: 0.0256 [05/21/2021-05:47:27] [V] [TRT] Tactic: 10747903 Time: 0.019328 [05/21/2021-05:47:27] [V] [TRT] Tactic: 10944511 Time: 0.020376 [05/21/2021-05:47:27] [V] [TRT] Fastest Tactic: 6422527 Time: 0.01856 [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:27] [V] [TRT] Tactic: 2195670545862694453 Time: 0.012544 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:27] [V] [TRT] Tactic: 3891805945559659536 Time: 0.01208 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:47:27] [V] [TRT] Tactic: 4418200634486186714 Time: 0.01216 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:27] [V] [TRT] Tactic: 5548126322150286555 Time: 0.012032 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:27] [V] [TRT] Tactic: 6057304366605292508 Time: 0.011852 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:47:27] [V] [TRT] Tactic: 7392644644614664811 Time: 0.012032 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:47:27] [V] [TRT] Tactic: -4884039206922900293 Time: 0.012032 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:27] [V] [TRT] Tactic: -4374269919094467161 Time: 0.012672 [05/21/2021-05:47:27] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:27] [V] [TRT] Tactic: -1546027692247304867 Time: 0.012032 [05/21/2021-05:47:27] [V] [TRT] Fastest Tactic: 6057304366605292508 Time: 0.011852 [05/21/2021-05:47:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6057304366605292508 [05/21/2021-05:47:27] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:27] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:28] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:47:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:28] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:28] [V] [TRT] Tactic: 0 Time: 0.022676 [05/21/2021-05:47:28] [V] [TRT] Tactic: 1 Time: 0.022408 [05/21/2021-05:47:28] [V] [TRT] Tactic: 2 Time: 0.041216 [05/21/2021-05:47:28] [V] [TRT] Tactic: 56 Time: 0.022528 [05/21/2021-05:47:28] [V] [TRT] Tactic: 58 Time: 0.04142 [05/21/2021-05:47:28] [V] [TRT] Fastest Tactic: 1 Time: 0.022408 [05/21/2021-05:47:28] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:28] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:28] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:28] [V] [TRT] Tactic: 254850674756030979 Time: 0.0128 [05/21/2021-05:47:28] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:28] [V] [TRT] Tactic: 1156328698016730421 Time: 0.011648 [05/21/2021-05:47:28] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:47:28] [V] [TRT] Tactic: 1362727228442059924 Time: 0.00872 [05/21/2021-05:47:28] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:47:28] [V] [TRT] Tactic: 1576319725282257846 Time: 0.01114 [05/21/2021-05:47:28] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:29] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01144 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:29] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011416 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:29] [V] [TRT] Tactic: 1899296423087490472 Time: 0.012288 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:47:29] [V] [TRT] Tactic: 2238656696610018305 Time: 0.011276 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:29] [V] [TRT] Tactic: 2541579301352125276 Time: 0.008632 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:47:29] [V] [TRT] Tactic: 2559328254295148085 Time: 0.010772 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:29] [V] [TRT] Tactic: 2657157263811141609 Time: 0.013184 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:29] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011432 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012176 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3359475309458902373 Time: 0.01088 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0088 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3513075359009385578 Time: 0.01024 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3704534001553878387 Time: 0.008192 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:47:29] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009188 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4278315135102886928 Time: 0.010152 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4370476717970497892 Time: 0.010588 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009796 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01064 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00872 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4571819373777460444 Time: 0.010368 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4595173549602041350 Time: 0.010624 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4802447371470387646 Time: 0.009344 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:47:29] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0096 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:29] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0101 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:47:29] [V] [TRT] Tactic: 5205510332404400949 Time: 0.008132 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:47:29] [V] [TRT] Tactic: 5346855796032465921 Time: 0.008192 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:29] [V] [TRT] Tactic: 5398999388616959893 Time: 0.008936 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:29] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009984 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:29] [V] [TRT] Tactic: 6377497238381488891 Time: 0.008788 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:29] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011936 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:47:29] [V] [TRT] Tactic: 6697277555581639516 Time: 0.009992 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:29] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011264 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:29] [V] [TRT] Tactic: 7216571380637776659 Time: 0.008832 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:29] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010224 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:29] [V] [TRT] Tactic: 8101703987960976805 Time: 0.012964 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:29] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011296 [05/21/2021-05:47:29] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:47:30] [V] [TRT] Tactic: 8764780417487154889 Time: 0.009216 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:47:30] [V] [TRT] Tactic: 8823554289762712606 Time: 0.009984 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:30] [V] [TRT] Tactic: 8839784824303350101 Time: 0.008624 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:47:30] [V] [TRT] Tactic: -9203179519031456182 Time: 0.009472 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:30] [V] [TRT] Tactic: -9009272790678027912 Time: 0.009584 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:30] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011976 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:47:30] [V] [TRT] Tactic: -8280443484414412687 Time: 0.010408 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:47:30] [V] [TRT] Tactic: -8205952393017864204 Time: 0.010652 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:47:30] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009704 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:47:30] [V] [TRT] Tactic: -7410012245391920273 Time: 0.012248 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:47:30] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008832 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:47:30] [V] [TRT] Tactic: -7089118800560870395 Time: 0.010336 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:47:30] [V] [TRT] Tactic: -6768327495007644783 Time: 0.00768 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:30] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01344 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:30] [V] [TRT] Tactic: -6063766379489217211 Time: 0.010368 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:30] [V] [TRT] Tactic: -5530886555766748586 Time: 0.008768 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:47:30] [V] [TRT] Tactic: -5409588854490562130 Time: 0.009508 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:30] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011292 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:30] [V] [TRT] Tactic: -5127240325355316006 Time: 0.009944 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01024 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011416 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4548822885169694805 Time: 0.012172 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4379519430184503304 Time: 0.01024 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4293222705763522367 Time: 0.01024 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4152066959007262150 Time: 0.010624 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:30] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009676 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011112 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3905653247016903130 Time: 0.009228 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3903342530518878192 Time: 0.009232 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3864869056275745423 Time: 0.009176 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010924 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:30] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011412 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:47:30] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0094 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:47:30] [V] [TRT] Tactic: -2602982885923184927 Time: 0.00844 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:47:30] [V] [TRT] Tactic: -2353603993968373338 Time: 0.009344 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:47:30] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011264 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:47:30] [V] [TRT] Tactic: -2003055242756584050 Time: 0.009456 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1985778916402815946 Time: 0.009268 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1828674067637788567 Time: 0.011316 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1640527254204634147 Time: 0.01054 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1562548049711204899 Time: 0.007552 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009872 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011312 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:47:30] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009856 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:47:30] [V] [TRT] Tactic: -406984317033388136 Time: 0.008576 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:47:30] [V] [TRT] Tactic: -331499326992534460 Time: 0.009804 [05/21/2021-05:47:30] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:47:30] [V] [TRT] Tactic: -206523504474952360 Time: 0.009344 [05/21/2021-05:47:30] [V] [TRT] Fastest Tactic: -1562548049711204899 Time: 0.007552 [05/21/2021-05:47:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1562548049711204899 [05/21/2021-05:47:30] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:30] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution) [05/21/2021-05:47:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:30] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution) [05/21/2021-05:47:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:30] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution) [05/21/2021-05:47:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:30] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:30] [V] [TRT] Tactic: 1002 Time: 0.01472 [05/21/2021-05:47:30] [V] [TRT] Tactic: 0 Time: 0.016304 [05/21/2021-05:47:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.01472 [05/21/2021-05:47:30] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014976 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.016512 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014976 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014356 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.01132 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.01132 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.013572 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.009032 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.009032 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.012688 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.01088 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.01088 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.012684 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.016256 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.012684 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.015516 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.015516 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.021888 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014176 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.014976 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014176 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014336 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.01536 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01222 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.01152 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.01152 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.009308 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.009344 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.009308 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.015544 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.013968 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.013968 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.021632 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.012184 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012184 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014252 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.015232 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014252 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014464 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.015476 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014464 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.012288 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.012316 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.015952 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.011052 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.011052 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.013184 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.016128 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.013184 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01324 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.016384 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.01324 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.013952 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.007552 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.010664 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.00704 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00704 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.010924 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.015336 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.010924 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.016964 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.008832 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.008832 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01386 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.012416 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.013328 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.012912 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012912 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.021384 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.007444 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007444 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.012292 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.006572 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006572 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:31] [V] [TRT] Tactic: 0 Time: 0.011532 [05/21/2021-05:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.011532 [05/21/2021-05:47:31] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:31] [V] [TRT] Tactic: 1002 Time: 0.014232 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.006148 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006148 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.009856 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.009748 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.009748 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.009856 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.011248 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.009856 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.018628 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.006272 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.013056 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.010304 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.011136 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.010304 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.014208 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.014208 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.014208 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.0116 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.011176 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.011176 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.011528 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.01216 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.011528 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.01856 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.013716 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.013716 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.01332 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:32] [V] [TRT] Tactic: 1002 Time: 0.0096 [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.010368 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0096 [05/21/2021-05:47:32] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudaDepthwiseConvolution) [05/21/2021-05:47:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (FusedConvActConvolution) [05/21/2021-05:47:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:32] [V] [TRT] Tactic: 0 Time: 0.02624 [05/21/2021-05:47:32] [V] [TRT] Tactic: 1 Time: 0.026368 [05/21/2021-05:47:32] [V] [TRT] Tactic: 2 Time: 0.054912 [05/21/2021-05:47:32] [V] [TRT] Tactic: 4 Time: 1.36761 [05/21/2021-05:47:32] [V] [TRT] Tactic: 5 Time: 0.055028 [05/21/2021-05:47:32] [V] [TRT] Tactic: 56 Time: 0.02688 [05/21/2021-05:47:32] [V] [TRT] Tactic: 57 Time: 0.02682 [05/21/2021-05:47:32] [V] [TRT] Tactic: 58 Time: 0.054912 [05/21/2021-05:47:32] [V] [TRT] Tactic: 60 Time: 1.36766 [05/21/2021-05:47:32] [V] [TRT] Tactic: 61 Time: 0.055008 [05/21/2021-05:47:32] [V] [TRT] Tactic: 112 Time: 0.026804 [05/21/2021-05:47:32] [V] [TRT] Tactic: 113 Time: 0.026624 [05/21/2021-05:47:32] [V] [TRT] Tactic: 114 Time: 0.055304 [05/21/2021-05:47:32] [V] [TRT] Tactic: 116 Time: 1.36759 [05/21/2021-05:47:32] [V] [TRT] Tactic: 117 Time: 0.054736 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 0 Time: 0.02624 [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:32] [V] [TRT] Tactic: 4549827808004681195 Time: 0.02048 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:32] [V] [TRT] Tactic: 5779835512569528575 Time: 0.01864 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:47:32] [V] [TRT] Tactic: 9151672657204310840 Time: 0.029044 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:47:32] [V] [TRT] Tactic: -7491730084094677098 Time: 0.021248 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:47:32] [V] [TRT] Tactic: -6622064180404051845 Time: 0.037888 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:32] [V] [TRT] Tactic: -6313876406580483184 Time: 0.02304 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:47:32] [V] [TRT] Tactic: -6273689210331812572 Time: 0.019748 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:47:32] [V] [TRT] Tactic: -4337126844824617177 Time: 0.019824 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:32] [V] [TRT] Tactic: -1123676555321336786 Time: 0.01984 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:32] [V] [TRT] Tactic: -701551393537224327 Time: 0.020608 [05/21/2021-05:47:32] [V] [TRT] Fastest Tactic: 5779835512569528575 Time: 0.01864 [05/21/2021-05:47:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5779835512569528575 [05/21/2021-05:47:32] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:32] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:32] [V] [TRT] Tactic: 1663866669559596164 Time: 0.02182 [05/21/2021-05:47:32] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:33] [V] [TRT] Tactic: 2860655430572478466 Time: 0.020864 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:33] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023692 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:33] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023576 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:33] [V] [TRT] Tactic: 4696204239951173149 Time: 0.020268 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:33] [V] [TRT] Tactic: 5778138195697110003 Time: 0.020924 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:33] [V] [TRT] Tactic: 8918020581761223752 Time: 0.021776 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:33] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02036 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:33] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023276 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:33] [V] [TRT] Tactic: -2809379259463049391 Time: 0.02192 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:33] [V] [TRT] Tactic: -1985235291706575900 Time: 0.02052 [05/21/2021-05:47:33] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:33] [V] [TRT] Tactic: -504296718212024303 Time: 0.021656 [05/21/2021-05:47:33] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.020268 [05/21/2021-05:47:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149 [05/21/2021-05:47:33] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:47:34] [V] [TRT] Tactic: 1373022415249282411 Time: 0.01646 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:34] [V] [TRT] Tactic: 1663866669559596164 Time: 0.020568 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:34] [V] [TRT] Tactic: 2860655430572478466 Time: 0.021148 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:34] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024704 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:34] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024288 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:34] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02112 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:34] [V] [TRT] Tactic: 5778138195697110003 Time: 0.02206 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:34] [V] [TRT] Tactic: 8918020581761223752 Time: 0.021376 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:47:34] [V] [TRT] Tactic: -7067026478815706014 Time: 0.018316 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:34] [V] [TRT] Tactic: -5905193483742532701 Time: 0.019968 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:34] [V] [TRT] Tactic: -4035591156787122265 Time: 0.024192 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:34] [V] [TRT] Tactic: -2809379259463049391 Time: 0.021888 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:34] [V] [TRT] Tactic: -1985235291706575900 Time: 0.02048 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:34] [V] [TRT] Tactic: -504296718212024303 Time: 0.02048 [05/21/2021-05:47:34] [V] [TRT] Fastest Tactic: 1373022415249282411 Time: 0.01646 [05/21/2021-05:47:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1373022415249282411 [05/21/2021-05:47:34] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:34] [V] [TRT] Tactic: 0 Time: 0.020436 [05/21/2021-05:47:34] [V] [TRT] Tactic: 1 Time: 0.020768 [05/21/2021-05:47:34] [V] [TRT] Tactic: 2 Time: 0.048676 [05/21/2021-05:47:34] [V] [TRT] Tactic: 4 Time: 1.3703 [05/21/2021-05:47:34] [V] [TRT] Tactic: 5 Time: 0.052328 [05/21/2021-05:47:34] [V] [TRT] Tactic: 56 Time: 0.021932 [05/21/2021-05:47:34] [V] [TRT] Tactic: 58 Time: 0.043968 [05/21/2021-05:47:34] [V] [TRT] Tactic: 60 Time: 1.36721 [05/21/2021-05:47:34] [V] [TRT] Tactic: 61 Time: 0.052644 [05/21/2021-05:47:34] [V] [TRT] Fastest Tactic: 0 Time: 0.020436 [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:47:34] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (FusedConvActConvolution) [05/21/2021-05:47:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:34] [V] [TRT] Tactic: 2195670545862694453 Time: 0.013952 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:34] [V] [TRT] Tactic: 3891805945559659536 Time: 0.011564 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:47:34] [V] [TRT] Tactic: 4418200634486186714 Time: 0.01152 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:34] [V] [TRT] Tactic: 5548126322150286555 Time: 0.012288 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:34] [V] [TRT] Tactic: 6057304366605292508 Time: 0.012288 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:47:34] [V] [TRT] Tactic: 7392644644614664811 Time: 0.013872 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:47:34] [V] [TRT] Tactic: -4884039206922900293 Time: 0.013328 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:34] [V] [TRT] Tactic: -4374269919094467161 Time: 0.013568 [05/21/2021-05:47:34] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:34] [V] [TRT] Tactic: -1546027692247304867 Time: 0.013312 [05/21/2021-05:47:34] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.01152 [05/21/2021-05:47:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:47:34] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudaDepthwiseConvolution) [05/21/2021-05:47:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:34] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:34] [V] [TRT] Tactic: 0 Time: 0.02868 [05/21/2021-05:47:34] [V] [TRT] Tactic: 1 Time: 0.028544 [05/21/2021-05:47:34] [V] [TRT] Tactic: 2 Time: 0.047232 [05/21/2021-05:47:35] [V] [TRT] Tactic: 56 Time: 0.028672 [05/21/2021-05:47:35] [V] [TRT] Tactic: 58 Time: 0.047104 [05/21/2021-05:47:35] [V] [TRT] Fastest Tactic: 1 Time: 0.028544 [05/21/2021-05:47:35] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:35] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:35] [V] [TRT] Tactic: 254850674756030979 Time: 0.011252 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0092 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1362727228442059924 Time: 0.008832 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1576319725282257846 Time: 0.013696 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1832046141070096030 Time: 0.013952 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1838082074606840426 Time: 0.014364 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:35] [V] [TRT] Tactic: 1899296423087490472 Time: 0.016236 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:47:35] [V] [TRT] Tactic: 2238656696610018305 Time: 0.01358 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:35] [V] [TRT] Tactic: 2541579301352125276 Time: 0.010776 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:47:35] [V] [TRT] Tactic: 2559328254295148085 Time: 0.011944 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:35] [V] [TRT] Tactic: 2657157263811141609 Time: 0.016928 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:35] [V] [TRT] Tactic: 2968605903460894194 Time: 0.013952 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3071479995783211391 Time: 0.013352 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010352 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3362537467505018070 Time: 0.009324 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3513075359009385578 Time: 0.011264 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3704534001553878387 Time: 0.011028 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:47:35] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0116 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011924 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4370476717970497892 Time: 0.01276 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4480294673430783793 Time: 0.012388 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4491683531415781597 Time: 0.012032 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4528997467275241200 Time: 0.010496 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4571819373777460444 Time: 0.012452 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4595173549602041350 Time: 0.010236 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4802447371470387646 Time: 0.009472 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:47:35] [V] [TRT] Tactic: 4993757826442493905 Time: 0.009344 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:35] [V] [TRT] Tactic: 5059676457552313631 Time: 0.011264 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:47:35] [V] [TRT] Tactic: 5205510332404400949 Time: 0.010812 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:47:35] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011016 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:35] [V] [TRT] Tactic: 5398999388616959893 Time: 0.01152 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:35] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01152 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:35] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01096 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:35] [V] [TRT] Tactic: 6468794451065529747 Time: 0.01472 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:47:35] [V] [TRT] Tactic: 6697277555581639516 Time: 0.01184 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:35] [V] [TRT] Tactic: 6859477213531075460 Time: 0.014244 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:35] [V] [TRT] Tactic: 7216571380637776659 Time: 0.011372 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:35] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011008 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:35] [V] [TRT] Tactic: 8101703987960976805 Time: 0.014108 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:35] [V] [TRT] Tactic: 8170606396342855895 Time: 0.012288 [05/21/2021-05:47:35] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:47:36] [V] [TRT] Tactic: 8764780417487154889 Time: 0.009636 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:47:36] [V] [TRT] Tactic: 8823554289762712606 Time: 0.012444 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:36] [V] [TRT] Tactic: 8839784824303350101 Time: 0.011264 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:47:36] [V] [TRT] Tactic: -9203179519031456182 Time: 0.010548 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:36] [V] [TRT] Tactic: -9009272790678027912 Time: 0.011572 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:36] [V] [TRT] Tactic: -8604374562669615024 Time: 0.014552 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:47:36] [V] [TRT] Tactic: -8280443484414412687 Time: 0.012544 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:47:36] [V] [TRT] Tactic: -8205952393017864204 Time: 0.012072 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:47:36] [V] [TRT] Tactic: -8131857373260504832 Time: 0.012128 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:47:36] [V] [TRT] Tactic: -7410012245391920273 Time: 0.015744 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:47:36] [V] [TRT] Tactic: -7099920365135295801 Time: 0.011392 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:47:36] [V] [TRT] Tactic: -7089118800560870395 Time: 0.011508 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:47:36] [V] [TRT] Tactic: -6768327495007644783 Time: 0.008192 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:36] [V] [TRT] Tactic: -6356316196810535311 Time: 0.014372 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:36] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011256 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:36] [V] [TRT] Tactic: -5530886555766748586 Time: 0.009076 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:47:36] [V] [TRT] Tactic: -5409588854490562130 Time: 0.010496 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:36] [V] [TRT] Tactic: -5161596964442251102 Time: 0.013496 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:36] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0115 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4950923835688973492 Time: 0.011524 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4796511246675321840 Time: 0.013764 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4548822885169694805 Time: 0.015328 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4379519430184503304 Time: 0.013064 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4293222705763522367 Time: 0.012968 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4152066959007262150 Time: 0.012672 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:36] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011904 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3987638434926559037 Time: 0.014188 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01152 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3903342530518878192 Time: 0.011084 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3864869056275745423 Time: 0.011672 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3601464762214218301 Time: 0.01322 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:36] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011576 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:47:36] [V] [TRT] Tactic: -2878731503146438856 Time: 0.008228 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:47:36] [V] [TRT] Tactic: -2602982885923184927 Time: 0.008596 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:47:36] [V] [TRT] Tactic: -2353603993968373338 Time: 0.009264 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:47:36] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011504 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:47:36] [V] [TRT] Tactic: -2003055242756584050 Time: 0.011692 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1985778916402815946 Time: 0.011788 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1828674067637788567 Time: 0.015372 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1640527254204634147 Time: 0.013584 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1562548049711204899 Time: 0.010752 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1242202084391243207 Time: 0.011412 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1099247066487349374 Time: 0.013568 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:47:36] [V] [TRT] Tactic: -1038291877007553549 Time: 0.012544 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:47:36] [V] [TRT] Tactic: -406984317033388136 Time: 0.01064 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:47:36] [V] [TRT] Tactic: -331499326992534460 Time: 0.012696 [05/21/2021-05:47:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:47:36] [V] [TRT] Tactic: -206523504474952360 Time: 0.011032 [05/21/2021-05:47:36] [V] [TRT] Fastest Tactic: -6768327495007644783 Time: 0.008192 [05/21/2021-05:47:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6768327495007644783 [05/21/2021-05:47:36] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution) [05/21/2021-05:47:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution) [05/21/2021-05:47:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution) [05/21/2021-05:47:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:36] [V] [TRT] Tactic: 1002 Time: 0.014768 [05/21/2021-05:47:36] [V] [TRT] Tactic: 0 Time: 0.016384 [05/21/2021-05:47:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.014768 [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:36] [V] [TRT] Tactic: 1002 Time: 0.013376 [05/21/2021-05:47:36] [V] [TRT] Tactic: 0 Time: 0.015736 [05/21/2021-05:47:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.013376 [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:36] [V] [TRT] Tactic: 1002 Time: 0.014348 [05/21/2021-05:47:36] [V] [TRT] Tactic: 0 Time: 0.011264 [05/21/2021-05:47:36] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [05/21/2021-05:47:36] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:36] [V] [TRT] Tactic: 1002 Time: 0.0141 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.009548 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.009548 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.0128 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.010872 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.010872 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.012548 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.016256 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012548 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.01856 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015744 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.015744 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.021544 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.011944 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.011944 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.014136 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015104 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.014136 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.013736 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.009752 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.0096 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0096 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.01216 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.011556 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.011556 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.018508 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015488 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.015488 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.021544 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.012032 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.012032 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.014032 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015104 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.014032 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.014208 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015412 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.014208 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.012032 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.01242 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012032 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.012176 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.012356 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012176 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.016 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.011268 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.011268 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011264 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015348 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011268 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.01536 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.011268 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.012416 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.007692 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007692 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011648 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.007552 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011776 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.015752 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.011776 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.01654 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.008756 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.008756 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.013824 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.012416 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.012416 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.01334 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.0128 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0128 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.02176 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.00746 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00746 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011276 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.01132 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.011164 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.011164 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.013184 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.006172 [05/21/2021-05:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006172 [05/21/2021-05:47:37] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:37] [V] [TRT] Tactic: 1002 Time: 0.011564 [05/21/2021-05:47:37] [V] [TRT] Tactic: 0 Time: 0.011264 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.011724 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.012032 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.011724 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.018452 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.006168 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006168 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.013072 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(50176,1:16,896,16) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.010812 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.010348 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.010348 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,3136,56,1) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.01302 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.013556 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.01302 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,1,14336,256) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.012076 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.011264 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(200704,1:4,3584,64) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.012416 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(802816,3136,56,1) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.018432 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.013964 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.013964 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(401408,3136:2,56,1) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.012928 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.013852 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.012928 [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(100352,1:8,1792,32) (Reformat) [05/21/2021-05:47:38] [V] [TRT] Tactic: 1002 Time: 0.010756 [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.011136 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.010756 [05/21/2021-05:47:38] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.01116 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.01116 [05/21/2021-05:47:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:38] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:38] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:38] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:38] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:38] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:38] [V] [TRT] Tactic: 0 Time: 0.007256 [05/21/2021-05:47:38] [V] [TRT] Fastest Tactic: 0 Time: 0.007256 [05/21/2021-05:47:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:38] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:38] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:39] [V] [TRT] Tactic: 0 Time: 0.00716 [05/21/2021-05:47:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00716 [05/21/2021-05:47:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:39] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:39] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:39] [V] [TRT] Tactic: 0 Time: 0.008192 [05/21/2021-05:47:39] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [05/21/2021-05:47:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:39] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:39] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale) [05/21/2021-05:47:39] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:39] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:39] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:39] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:47:39] [V] [TRT] Tactic: 589823 Time: 0.062336 [05/21/2021-05:47:39] [V] [TRT] Tactic: 655359 Time: 0.051936 [05/21/2021-05:47:39] [V] [TRT] Tactic: 786431 Time: 0.029696 [05/21/2021-05:47:39] [V] [TRT] Tactic: 851967 Time: 0.034216 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1179647 Time: 0.020352 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1310719 Time: 0.044032 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1376255 Time: 0.06832 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1441791 Time: 0.028908 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1507327 Time: 0.038948 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1638399 Time: 0.025388 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1835007 Time: 0.030988 [05/21/2021-05:47:39] [V] [TRT] Tactic: 1900543 Time: 0.06454 [05/21/2021-05:47:39] [V] [TRT] Tactic: 2097151 Time: 0.022784 [05/21/2021-05:47:39] [V] [TRT] Tactic: 2162687 Time: 0.068352 [05/21/2021-05:47:39] [V] [TRT] Tactic: 2293759 Time: 0.044032 [05/21/2021-05:47:39] [V] [TRT] Tactic: 2359295 Time: 0.028672 [05/21/2021-05:47:39] [V] [TRT] Tactic: 2686975 Time: 0.044048 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3080191 Time: 0.027648 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3342335 Time: 0.029696 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3407871 Time: 0.027648 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3538943 Time: 0.021504 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3670015 Time: 0.11456 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3932159 Time: 0.059008 [05/21/2021-05:47:39] [V] [TRT] Tactic: 3997695 Time: 0.023272 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4063231 Time: 0.025888 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4194303 Time: 0.029584 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4259839 Time: 0.02318 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4325375 Time: 0.026936 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4521983 Time: 0.064416 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4587519 Time: 0.02048 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4653055 Time: 0.0192 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4915199 Time: 0.020512 [05/21/2021-05:47:39] [V] [TRT] Tactic: 4980735 Time: 0.027664 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5177343 Time: 0.020372 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5242879 Time: 0.037524 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5373951 Time: 0.02368 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5439487 Time: 0.032256 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5570559 Time: 0.038048 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5636095 Time: 0.026036 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5701631 Time: 0.063392 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5767167 Time: 0.05944 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5832703 Time: 0.038144 [05/21/2021-05:47:39] [V] [TRT] Tactic: 5898239 Time: 0.020608 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6029311 Time: 0.062124 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6225919 Time: 0.025988 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6291455 Time: 0.020236 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6422527 Time: 0.036224 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6750207 Time: 0.024064 [05/21/2021-05:47:39] [V] [TRT] Tactic: 6815743 Time: 0.040356 [05/21/2021-05:47:40] [V] [TRT] Tactic: 6946815 Time: 0.02968 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7012351 Time: 0.020668 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7077887 Time: 0.0209 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7143423 Time: 0.031744 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7208959 Time: 0.027264 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7340031 Time: 0.018176 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7405567 Time: 0.02536 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7536639 Time: 0.06 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7602175 Time: 0.027308 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7733247 Time: 0.02752 [05/21/2021-05:47:40] [V] [TRT] Tactic: 7798783 Time: 0.02944 [05/21/2021-05:47:40] [V] [TRT] Tactic: 8191999 Time: 0.026752 [05/21/2021-05:47:40] [V] [TRT] Tactic: 8257535 Time: 0.022272 [05/21/2021-05:47:40] [V] [TRT] Tactic: 8323071 Time: 0.028096 [05/21/2021-05:47:40] [V] [TRT] Tactic: 8650751 Time: 0.027916 [05/21/2021-05:47:40] [V] [TRT] Tactic: 8716287 Time: 0.027912 [05/21/2021-05:47:40] [V] [TRT] Tactic: 9109503 Time: 0.02298 [05/21/2021-05:47:40] [V] [TRT] Tactic: 9568255 Time: 0.022056 [05/21/2021-05:47:40] [V] [TRT] Tactic: 9895935 Time: 0.029504 [05/21/2021-05:47:40] [V] [TRT] Tactic: 10223615 Time: 0.065196 [05/21/2021-05:47:40] [V] [TRT] Tactic: 10354687 Time: 0.022096 [05/21/2021-05:47:40] [V] [TRT] Tactic: 10551295 Time: 0.040236 [05/21/2021-05:47:40] [V] [TRT] Tactic: 10747903 Time: 0.026512 [05/21/2021-05:47:40] [V] [TRT] Tactic: 10944511 Time: 0.038296 [05/21/2021-05:47:40] [V] [TRT] Fastest Tactic: 7340031 Time: 0.018176 [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:40] [V] [TRT] Tactic: 0 Time: 0.024384 [05/21/2021-05:47:40] [V] [TRT] Tactic: 1 Time: 0.024064 [05/21/2021-05:47:40] [V] [TRT] Tactic: 2 Time: 0.128032 [05/21/2021-05:47:40] [V] [TRT] Tactic: 4 Time: 1.37148 [05/21/2021-05:47:40] [V] [TRT] Tactic: 5 Time: 0.066328 [05/21/2021-05:47:40] [V] [TRT] Tactic: 56 Time: 0.030764 [05/21/2021-05:47:40] [V] [TRT] Tactic: 57 Time: 0.0265 [05/21/2021-05:47:40] [V] [TRT] Tactic: 58 Time: 0.132992 [05/21/2021-05:47:40] [V] [TRT] Tactic: 60 Time: 1.36819 [05/21/2021-05:47:40] [V] [TRT] Tactic: 61 Time: 0.067844 [05/21/2021-05:47:40] [V] [TRT] Tactic: 112 Time: 0.029096 [05/21/2021-05:47:40] [V] [TRT] Tactic: 113 Time: 0.025984 [05/21/2021-05:47:40] [V] [TRT] Tactic: 114 Time: 0.132224 [05/21/2021-05:47:40] [V] [TRT] Tactic: 116 Time: 1.36715 [05/21/2021-05:47:40] [V] [TRT] Tactic: 117 Time: 0.066844 [05/21/2021-05:47:40] [V] [TRT] Fastest Tactic: 1 Time: 0.024064 [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:40] [V] [TRT] Tactic: 4549827808004681195 Time: 0.03102 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:40] [V] [TRT] Tactic: 5779835512569528575 Time: 0.036352 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:47:40] [V] [TRT] Tactic: 9151672657204310840 Time: 0.054656 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:47:40] [V] [TRT] Tactic: -7491730084094677098 Time: 0.04544 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:47:40] [V] [TRT] Tactic: -6622064180404051845 Time: 0.05312 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:40] [V] [TRT] Tactic: -6313876406580483184 Time: 0.034776 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:47:40] [V] [TRT] Tactic: -6273689210331812572 Time: 0.034816 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:47:40] [V] [TRT] Tactic: -4337126844824617177 Time: 0.029352 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:40] [V] [TRT] Tactic: -1123676555321336786 Time: 0.036608 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:40] [V] [TRT] Tactic: -701551393537224327 Time: 0.031924 [05/21/2021-05:47:40] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.029352 [05/21/2021-05:47:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7340031 [05/21/2021-05:47:40] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:40] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:40] [V] [TRT] Tactic: 1663866669559596164 Time: 0.038016 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:40] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024176 [05/21/2021-05:47:40] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4474630279712975759 Time: 0.015508 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4479823862704990365 Time: 0.015492 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4696204239951173149 Time: 0.024448 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:41] [V] [TRT] Tactic: 5778138195697110003 Time: 0.038144 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:41] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0355 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:41] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022272 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:41] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016596 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:41] [V] [TRT] Tactic: -2809379259463049391 Time: 0.037564 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:41] [V] [TRT] Tactic: -1985235291706575900 Time: 0.035584 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:41] [V] [TRT] Tactic: -504296718212024303 Time: 0.033408 [05/21/2021-05:47:41] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.015492 [05/21/2021-05:47:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:41] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:47:41] [V] [TRT] Tactic: 1373022415249282411 Time: 0.02432 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:41] [V] [TRT] Tactic: 1663866669559596164 Time: 0.038264 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:41] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024588 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0172 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01696 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4696204239951173149 Time: 0.024192 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:41] [V] [TRT] Tactic: 5778138195697110003 Time: 0.038144 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:41] [V] [TRT] Tactic: 8918020581761223752 Time: 0.035344 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:47:41] [V] [TRT] Tactic: -7067026478815706014 Time: 0.030116 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:41] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022272 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:41] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016648 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:41] [V] [TRT] Tactic: -2809379259463049391 Time: 0.034816 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:41] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033224 [05/21/2021-05:47:41] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:41] [V] [TRT] Tactic: -504296718212024303 Time: 0.033408 [05/21/2021-05:47:41] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.016648 [05/21/2021-05:47:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:47:41] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:41] [V] [TRT] Tactic: 0 Time: 0.031104 [05/21/2021-05:47:41] [V] [TRT] Tactic: 1 Time: 0.026752 [05/21/2021-05:47:41] [V] [TRT] Tactic: 2 Time: 0.100352 [05/21/2021-05:47:41] [V] [TRT] Tactic: 4 Time: 1.36763 [05/21/2021-05:47:41] [V] [TRT] Tactic: 5 Time: 0.06876 [05/21/2021-05:47:41] [V] [TRT] Tactic: 56 Time: 0.026112 [05/21/2021-05:47:41] [V] [TRT] Tactic: 58 Time: 0.098304 [05/21/2021-05:47:41] [V] [TRT] Tactic: 60 Time: 1.36776 [05/21/2021-05:47:41] [V] [TRT] Tactic: 61 Time: 0.068236 [05/21/2021-05:47:41] [V] [TRT] Fastest Tactic: 56 Time: 0.026112 [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56 [05/21/2021-05:47:41] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:41] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:41] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:47:41] [V] [TRT] Tactic: 589823 Time: 0.03494 [05/21/2021-05:47:41] [V] [TRT] Tactic: 655359 Time: 0.025256 [05/21/2021-05:47:41] [V] [TRT] Tactic: 786431 Time: 0.016144 [05/21/2021-05:47:41] [V] [TRT] Tactic: 851967 Time: 0.02048 [05/21/2021-05:47:41] [V] [TRT] Tactic: 1179647 Time: 0.012416 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1310719 Time: 0.020596 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1376255 Time: 0.02676 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1441791 Time: 0.013304 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1507327 Time: 0.017408 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1638399 Time: 0.013312 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1835007 Time: 0.016384 [05/21/2021-05:47:42] [V] [TRT] Tactic: 1900543 Time: 0.026796 [05/21/2021-05:47:42] [V] [TRT] Tactic: 2097151 Time: 0.014896 [05/21/2021-05:47:42] [V] [TRT] Tactic: 2162687 Time: 0.028448 [05/21/2021-05:47:42] [V] [TRT] Tactic: 2293759 Time: 0.02652 [05/21/2021-05:47:42] [V] [TRT] Tactic: 2359295 Time: 0.018716 [05/21/2021-05:47:42] [V] [TRT] Tactic: 2686975 Time: 0.026752 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3080191 Time: 0.016588 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3342335 Time: 0.018396 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3407871 Time: 0.01728 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3538943 Time: 0.014208 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3670015 Time: 0.04544 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3932159 Time: 0.022676 [05/21/2021-05:47:42] [V] [TRT] Tactic: 3997695 Time: 0.014068 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4063231 Time: 0.015816 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4194303 Time: 0.01474 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4259839 Time: 0.01316 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4325375 Time: 0.013356 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4521983 Time: 0.025344 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4587519 Time: 0.012616 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4653055 Time: 0.0125 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4915199 Time: 0.013336 [05/21/2021-05:47:42] [V] [TRT] Tactic: 4980735 Time: 0.016824 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5177343 Time: 0.013056 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5242879 Time: 0.016816 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5373951 Time: 0.014104 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5439487 Time: 0.018356 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5570559 Time: 0.017884 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5636095 Time: 0.015908 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5701631 Time: 0.024848 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5767167 Time: 0.030848 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5832703 Time: 0.016992 [05/21/2021-05:47:42] [V] [TRT] Tactic: 5898239 Time: 0.013312 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6029311 Time: 0.024576 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6225919 Time: 0.013632 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6291455 Time: 0.012432 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6422527 Time: 0.016372 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6750207 Time: 0.013824 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6815743 Time: 0.01844 [05/21/2021-05:47:42] [V] [TRT] Tactic: 6946815 Time: 0.01814 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7012351 Time: 0.013696 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7077887 Time: 0.01344 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7143423 Time: 0.019596 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7208959 Time: 0.017284 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7340031 Time: 0.013224 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7405567 Time: 0.013604 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7536639 Time: 0.023228 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7602175 Time: 0.014352 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7733247 Time: 0.013976 [05/21/2021-05:47:42] [V] [TRT] Tactic: 7798783 Time: 0.016196 [05/21/2021-05:47:42] [V] [TRT] Tactic: 8191999 Time: 0.014464 [05/21/2021-05:47:42] [V] [TRT] Tactic: 8257535 Time: 0.013056 [05/21/2021-05:47:42] [V] [TRT] Tactic: 8323071 Time: 0.015496 [05/21/2021-05:47:42] [V] [TRT] Tactic: 8650751 Time: 0.015532 [05/21/2021-05:47:42] [V] [TRT] Tactic: 8716287 Time: 0.015252 [05/21/2021-05:47:43] [V] [TRT] Tactic: 9109503 Time: 0.013344 [05/21/2021-05:47:43] [V] [TRT] Tactic: 9568255 Time: 0.013208 [05/21/2021-05:47:43] [V] [TRT] Tactic: 9895935 Time: 0.014348 [05/21/2021-05:47:43] [V] [TRT] Tactic: 10223615 Time: 0.02612 [05/21/2021-05:47:43] [V] [TRT] Tactic: 10354687 Time: 0.012288 [05/21/2021-05:47:43] [V] [TRT] Tactic: 10551295 Time: 0.01792 [05/21/2021-05:47:43] [V] [TRT] Tactic: 10747903 Time: 0.013384 [05/21/2021-05:47:43] [V] [TRT] Tactic: 10944511 Time: 0.016384 [05/21/2021-05:47:43] [V] [TRT] Fastest Tactic: 10354687 Time: 0.012288 [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:43] [V] [TRT] Tactic: 2195670545862694453 Time: 0.018824 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:43] [V] [TRT] Tactic: 3891805945559659536 Time: 0.024576 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:47:43] [V] [TRT] Tactic: 4418200634486186714 Time: 0.016768 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:43] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018048 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:43] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017536 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:47:43] [V] [TRT] Tactic: 7392644644614664811 Time: 0.017152 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:47:43] [V] [TRT] Tactic: -4884039206922900293 Time: 0.024092 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:43] [V] [TRT] Tactic: -4374269919094467161 Time: 0.017664 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:43] [V] [TRT] Tactic: -1546027692247304867 Time: 0.024064 [05/21/2021-05:47:43] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.016768 [05/21/2021-05:47:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10354687 [05/21/2021-05:47:43] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:43] [V] [TRT] Tactic: 0 Time: 0.035328 [05/21/2021-05:47:43] [V] [TRT] Tactic: 1 Time: 0.03392 [05/21/2021-05:47:43] [V] [TRT] Tactic: 2 Time: 0.10752 [05/21/2021-05:47:43] [V] [TRT] Tactic: 56 Time: 0.034816 [05/21/2021-05:47:43] [V] [TRT] Tactic: 58 Time: 0.10816 [05/21/2021-05:47:43] [V] [TRT] Fastest Tactic: 1 Time: 0.03392 [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:43] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:43] [V] [TRT] Tactic: 254850674756030979 Time: 0.016372 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:43] [V] [TRT] Tactic: 1156328698016730421 Time: 0.012416 [05/21/2021-05:47:43] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:47:44] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012484 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:47:44] [V] [TRT] Tactic: 1576319725282257846 Time: 0.009524 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:44] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009256 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:44] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009216 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:44] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008192 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:47:44] [V] [TRT] Tactic: 2238656696610018305 Time: 0.008832 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:44] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01102 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:47:44] [V] [TRT] Tactic: 2559328254295148085 Time: 0.01536 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:44] [V] [TRT] Tactic: 2657157263811141609 Time: 0.008192 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:44] [V] [TRT] Tactic: 2968605903460894194 Time: 0.00926 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009484 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009216 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3362537467505018070 Time: 0.011656 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3513075359009385578 Time: 0.016944 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3704534001553878387 Time: 0.011472 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:47:44] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007708 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4278315135102886928 Time: 0.00896 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008192 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007424 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01536 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4528997467275241200 Time: 0.011144 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4571819373777460444 Time: 0.016512 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016464 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0128 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:47:44] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00832 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:44] [V] [TRT] Tactic: 5059676457552313631 Time: 0.016384 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:47:44] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011044 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:47:44] [V] [TRT] Tactic: 5346855796032465921 Time: 0.012416 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:44] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012312 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:44] [V] [TRT] Tactic: 6034364043891107501 Time: 0.008148 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:44] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011264 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:44] [V] [TRT] Tactic: 6468794451065529747 Time: 0.009216 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:47:44] [V] [TRT] Tactic: 6697277555581639516 Time: 0.008704 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:44] [V] [TRT] Tactic: 6859477213531075460 Time: 0.007936 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:44] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013312 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:44] [V] [TRT] Tactic: 7609923741161019135 Time: 0.008576 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:44] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008192 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:44] [V] [TRT] Tactic: 8170606396342855895 Time: 0.009472 [05/21/2021-05:47:44] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:47:45] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012292 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:47:45] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008848 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:45] [V] [TRT] Tactic: 8839784824303350101 Time: 0.012704 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:47:45] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007768 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:45] [V] [TRT] Tactic: -9009272790678027912 Time: 0.01322 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:45] [V] [TRT] Tactic: -8604374562669615024 Time: 0.007952 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:47:45] [V] [TRT] Tactic: -8280443484414412687 Time: 0.015856 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:47:45] [V] [TRT] Tactic: -8205952393017864204 Time: 0.01536 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:47:45] [V] [TRT] Tactic: -8131857373260504832 Time: 0.008348 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:47:45] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008608 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:47:45] [V] [TRT] Tactic: -7099920365135295801 Time: 0.00868 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:47:45] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00766 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:47:45] [V] [TRT] Tactic: -6768327495007644783 Time: 0.011444 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:45] [V] [TRT] Tactic: -6356316196810535311 Time: 0.008248 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:45] [V] [TRT] Tactic: -6063766379489217211 Time: 0.009216 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:45] [V] [TRT] Tactic: -5530886555766748586 Time: 0.010612 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:47:45] [V] [TRT] Tactic: -5409588854490562130 Time: 0.007296 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:45] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009216 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:45] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008832 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008064 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4796511246675321840 Time: 0.009432 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4548822885169694805 Time: 0.007808 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008692 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4293222705763522367 Time: 0.007424 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4152066959007262150 Time: 0.016384 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:45] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008628 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009244 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3905653247016903130 Time: 0.012592 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012416 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3864869056275745423 Time: 0.012436 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3601464762214218301 Time: 0.007424 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:45] [V] [TRT] Tactic: -3058330359340425555 Time: 0.009292 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:47:45] [V] [TRT] Tactic: -2878731503146438856 Time: 0.012016 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:47:45] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011424 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:47:45] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012288 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:47:45] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009336 [05/21/2021-05:47:45] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:47:46] [V] [TRT] Tactic: -2003055242756584050 Time: 0.008212 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1985778916402815946 Time: 0.012532 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1828674067637788567 Time: 0.009732 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009216 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1562548049711204899 Time: 0.011648 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1242202084391243207 Time: 0.008872 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1099247066487349374 Time: 0.007824 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:47:46] [V] [TRT] Tactic: -1038291877007553549 Time: 0.008704 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:47:46] [V] [TRT] Tactic: -406984317033388136 Time: 0.011392 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:47:46] [V] [TRT] Tactic: -331499326992534460 Time: 0.008516 [05/21/2021-05:47:46] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:47:46] [V] [TRT] Tactic: -206523504474952360 Time: 0.011776 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.007296 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.011356 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.011356 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.007552 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.007936 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007936 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.008992 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008992 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CudnnConvolution) [05/21/2021-05:47:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CublasConvolution) [05/21/2021-05:47:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CaskConvolution) [05/21/2021-05:47:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.011152 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.011152 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.007432 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007432 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.007624 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007624 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Tactic: 0 Time: 0.009012 [05/21/2021-05:47:46] [V] [TRT] Fastest Tactic: 0 Time: 0.009012 [05/21/2021-05:47:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale) [05/21/2021-05:47:46] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(401408,3136,56,1) *************** [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:46] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:47:46] [V] [TRT] Tactic: 589823 Time: 0.067584 [05/21/2021-05:47:46] [V] [TRT] Tactic: 655359 Time: 0.04992 [05/21/2021-05:47:46] [V] [TRT] Tactic: 786431 Time: 0.037904 [05/21/2021-05:47:46] [V] [TRT] Tactic: 851967 Time: 0.037072 [05/21/2021-05:47:46] [V] [TRT] Tactic: 1179647 Time: 0.031964 [05/21/2021-05:47:46] [V] [TRT] Tactic: 1310719 Time: 0.043904 [05/21/2021-05:47:46] [V] [TRT] Tactic: 1376255 Time: 0.073876 [05/21/2021-05:47:46] [V] [TRT] Tactic: 1441791 Time: 0.041424 [05/21/2021-05:47:46] [V] [TRT] Tactic: 1507327 Time: 0.047236 [05/21/2021-05:47:47] [V] [TRT] Tactic: 1638399 Time: 0.041856 [05/21/2021-05:47:47] [V] [TRT] Tactic: 1835007 Time: 0.049284 [05/21/2021-05:47:47] [V] [TRT] Tactic: 1900543 Time: 0.073264 [05/21/2021-05:47:47] [V] [TRT] Tactic: 2097151 Time: 0.036624 [05/21/2021-05:47:47] [V] [TRT] Tactic: 2162687 Time: 0.074368 [05/21/2021-05:47:47] [V] [TRT] Tactic: 2293759 Time: 0.072192 [05/21/2021-05:47:47] [V] [TRT] Tactic: 2359295 Time: 0.048652 [05/21/2021-05:47:47] [V] [TRT] Tactic: 2686975 Time: 0.072872 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3080191 Time: 0.044544 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3342335 Time: 0.03584 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3407871 Time: 0.03708 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3538943 Time: 0.033036 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3670015 Time: 0.082976 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3932159 Time: 0.047204 [05/21/2021-05:47:47] [V] [TRT] Tactic: 3997695 Time: 0.036224 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4063231 Time: 0.033664 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4194303 Time: 0.036308 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4259839 Time: 0.03462 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4325375 Time: 0.035984 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4521983 Time: 0.070828 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4587519 Time: 0.038452 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4653055 Time: 0.034944 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4915199 Time: 0.037032 [05/21/2021-05:47:47] [V] [TRT] Tactic: 4980735 Time: 0.045692 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5177343 Time: 0.035712 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5242879 Time: 0.0438 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5373951 Time: 0.044072 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5439487 Time: 0.051708 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5570559 Time: 0.045832 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5636095 Time: 0.03328 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5701631 Time: 0.070408 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5767167 Time: 0.102568 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5832703 Time: 0.034816 [05/21/2021-05:47:47] [V] [TRT] Tactic: 5898239 Time: 0.032256 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6029311 Time: 0.047096 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6225919 Time: 0.032512 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6291455 Time: 0.031812 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6422527 Time: 0.034248 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6750207 Time: 0.041488 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6815743 Time: 0.047248 [05/21/2021-05:47:47] [V] [TRT] Tactic: 6946815 Time: 0.047148 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7012351 Time: 0.036352 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7077887 Time: 0.033416 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7143423 Time: 0.071464 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7208959 Time: 0.045892 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7340031 Time: 0.035468 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7405567 Time: 0.033584 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7536639 Time: 0.066432 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7602175 Time: 0.036228 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7733247 Time: 0.034956 [05/21/2021-05:47:47] [V] [TRT] Tactic: 7798783 Time: 0.038784 [05/21/2021-05:47:47] [V] [TRT] Tactic: 8191999 Time: 0.047876 [05/21/2021-05:47:47] [V] [TRT] Tactic: 8257535 Time: 0.038044 [05/21/2021-05:47:47] [V] [TRT] Tactic: 8323071 Time: 0.039068 [05/21/2021-05:47:47] [V] [TRT] Tactic: 8650751 Time: 0.038784 [05/21/2021-05:47:47] [V] [TRT] Tactic: 8716287 Time: 0.03996 [05/21/2021-05:47:47] [V] [TRT] Tactic: 9109503 Time: 0.036224 [05/21/2021-05:47:47] [V] [TRT] Tactic: 9568255 Time: 0.033068 [05/21/2021-05:47:47] [V] [TRT] Tactic: 9895935 Time: 0.032768 [05/21/2021-05:47:47] [V] [TRT] Tactic: 10223615 Time: 0.050336 [05/21/2021-05:47:48] [V] [TRT] Tactic: 10354687 Time: 0.036992 [05/21/2021-05:47:48] [V] [TRT] Tactic: 10551295 Time: 0.04776 [05/21/2021-05:47:48] [V] [TRT] Tactic: 10747903 Time: 0.034304 [05/21/2021-05:47:48] [V] [TRT] Tactic: 10944511 Time: 0.045696 [05/21/2021-05:47:48] [V] [TRT] Fastest Tactic: 6291455 Time: 0.031812 [05/21/2021-05:47:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:48] [V] [TRT] Tactic: 0 Time: 0.03392 [05/21/2021-05:47:48] [V] [TRT] Tactic: 1 Time: 0.034048 [05/21/2021-05:47:48] [V] [TRT] Tactic: 2 Time: 0.14848 [05/21/2021-05:47:48] [V] [TRT] Tactic: 4 Time: 3.05337 [05/21/2021-05:47:48] [V] [TRT] Tactic: 5 Time: 0.074036 [05/21/2021-05:47:48] [V] [TRT] Tactic: 56 Time: 0.034104 [05/21/2021-05:47:48] [V] [TRT] Tactic: 57 Time: 0.03392 [05/21/2021-05:47:48] [V] [TRT] Tactic: 58 Time: 0.147968 [05/21/2021-05:47:48] [V] [TRT] Tactic: 60 Time: 3.05291 [05/21/2021-05:47:48] [V] [TRT] Tactic: 61 Time: 0.074304 [05/21/2021-05:47:48] [V] [TRT] Tactic: 112 Time: 0.03392 [05/21/2021-05:47:48] [V] [TRT] Tactic: 113 Time: 0.034432 [05/21/2021-05:47:48] [V] [TRT] Tactic: 114 Time: 0.147384 [05/21/2021-05:47:48] [V] [TRT] Tactic: 116 Time: 2.74927 [05/21/2021-05:47:48] [V] [TRT] Tactic: 117 Time: 0.07362 [05/21/2021-05:47:48] [V] [TRT] Fastest Tactic: 0 Time: 0.03392 [05/21/2021-05:47:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:48] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:48] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:48] [V] [TRT] Tactic: 4549827808004681195 Time: 0.031488 [05/21/2021-05:47:48] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:48] [V] [TRT] Tactic: 5779835512569528575 Time: 0.036864 [05/21/2021-05:47:48] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:47:48] [V] [TRT] Tactic: 9151672657204310840 Time: 0.054528 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:47:49] [V] [TRT] Tactic: -7491730084094677098 Time: 0.045824 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:47:49] [V] [TRT] Tactic: -6622064180404051845 Time: 0.052864 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:49] [V] [TRT] Tactic: -6313876406580483184 Time: 0.037832 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:47:49] [V] [TRT] Tactic: -6273689210331812572 Time: 0.034816 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:47:49] [V] [TRT] Tactic: -4337126844824617177 Time: 0.026752 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:49] [V] [TRT] Tactic: -1123676555321336786 Time: 0.036376 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:49] [V] [TRT] Tactic: -701551393537224327 Time: 0.032896 [05/21/2021-05:47:49] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.026752 [05/21/2021-05:47:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177 [05/21/2021-05:47:49] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(401408,1,7168,128) *************** [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:49] [V] [TRT] Tactic: 1663866669559596164 Time: 0.038428 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:49] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024576 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4474630279712975759 Time: 0.025856 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025608 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02252 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:49] [V] [TRT] Tactic: 5778138195697110003 Time: 0.03584 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:49] [V] [TRT] Tactic: 8918020581761223752 Time: 0.032772 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:49] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0224 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:49] [V] [TRT] Tactic: -4035591156787122265 Time: 0.024984 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:49] [V] [TRT] Tactic: -2809379259463049391 Time: 0.038572 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:49] [V] [TRT] Tactic: -1985235291706575900 Time: 0.036032 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:49] [V] [TRT] Tactic: -504296718212024303 Time: 0.03644 [05/21/2021-05:47:49] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.0224 [05/21/2021-05:47:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701 [05/21/2021-05:47:49] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(100352,1:4,1792,32) *************** [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:49] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:47:49] [V] [TRT] Tactic: 1373022415249282411 Time: 0.024448 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:47:49] [V] [TRT] Tactic: 1663866669559596164 Time: 0.035316 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:49] [V] [TRT] Tactic: 2860655430572478466 Time: 0.022632 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4474630279712975759 Time: 0.025864 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025728 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:49] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02412 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:49] [V] [TRT] Tactic: 5778138195697110003 Time: 0.038912 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:49] [V] [TRT] Tactic: 8918020581761223752 Time: 0.03598 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:47:49] [V] [TRT] Tactic: -7067026478815706014 Time: 0.030428 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:47:49] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02258 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:47:49] [V] [TRT] Tactic: -4035591156787122265 Time: 0.02446 [05/21/2021-05:47:49] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:50] [V] [TRT] Tactic: -2809379259463049391 Time: 0.035364 [05/21/2021-05:47:50] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:47:50] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0329 [05/21/2021-05:47:50] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:50] [V] [TRT] Tactic: -504296718212024303 Time: 0.03404 [05/21/2021-05:47:50] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.02258 [05/21/2021-05:47:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701 [05/21/2021-05:47:50] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(401408,3136,56,1) *************** [05/21/2021-05:47:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:50] [V] [TRT] Tactic: 0 Time: 0.031872 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1 Time: 0.031744 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2 Time: 0.126464 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4 Time: 3.02856 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5 Time: 0.074088 [05/21/2021-05:47:50] [V] [TRT] Tactic: 56 Time: 0.03264 [05/21/2021-05:47:50] [V] [TRT] Tactic: 58 Time: 0.13056 [05/21/2021-05:47:50] [V] [TRT] Tactic: 60 Time: 3.00531 [05/21/2021-05:47:50] [V] [TRT] Tactic: 61 Time: 0.074508 [05/21/2021-05:47:50] [V] [TRT] Fastest Tactic: 1 Time: 0.031744 [05/21/2021-05:47:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:47:50] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136,56,1) *************** [05/21/2021-05:47:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:50] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136:2,56,1) *************** [05/21/2021-05:47:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:47:50] [V] [TRT] Tactic: 589823 Time: 0.03692 [05/21/2021-05:47:50] [V] [TRT] Tactic: 655359 Time: 0.029696 [05/21/2021-05:47:50] [V] [TRT] Tactic: 786431 Time: 0.0205 [05/21/2021-05:47:50] [V] [TRT] Tactic: 851967 Time: 0.022536 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1179647 Time: 0.018432 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1310719 Time: 0.023808 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1376255 Time: 0.031532 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1441791 Time: 0.019328 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1507327 Time: 0.0224 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1638399 Time: 0.020728 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1835007 Time: 0.025216 [05/21/2021-05:47:50] [V] [TRT] Tactic: 1900543 Time: 0.03108 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2097151 Time: 0.021376 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2162687 Time: 0.031872 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2293759 Time: 0.029216 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2359295 Time: 0.022912 [05/21/2021-05:47:50] [V] [TRT] Tactic: 2686975 Time: 0.029452 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3080191 Time: 0.020736 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3342335 Time: 0.022496 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3407871 Time: 0.022272 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3538943 Time: 0.019468 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3670015 Time: 0.04972 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3932159 Time: 0.027216 [05/21/2021-05:47:50] [V] [TRT] Tactic: 3997695 Time: 0.021284 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4063231 Time: 0.018444 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4194303 Time: 0.018432 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4259839 Time: 0.018468 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4325375 Time: 0.018436 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4521983 Time: 0.027776 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4587519 Time: 0.018448 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4653055 Time: 0.019992 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4915199 Time: 0.019356 [05/21/2021-05:47:50] [V] [TRT] Tactic: 4980735 Time: 0.020864 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5177343 Time: 0.020224 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5242879 Time: 0.02112 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5373951 Time: 0.023416 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5439487 Time: 0.026012 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5570559 Time: 0.021676 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5636095 Time: 0.018944 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5701631 Time: 0.028672 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5767167 Time: 0.052096 [05/21/2021-05:47:50] [V] [TRT] Tactic: 5832703 Time: 0.021036 [05/21/2021-05:47:51] [V] [TRT] Tactic: 5898239 Time: 0.019312 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6029311 Time: 0.02816 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6225919 Time: 0.018944 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6291455 Time: 0.018944 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6422527 Time: 0.020864 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6750207 Time: 0.02232 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6815743 Time: 0.02432 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6946815 Time: 0.023844 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7012351 Time: 0.020608 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7077887 Time: 0.01886 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7143423 Time: 0.03406 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7208959 Time: 0.022016 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7340031 Time: 0.019208 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7405567 Time: 0.019152 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7536639 Time: 0.02704 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7602175 Time: 0.019328 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7733247 Time: 0.01868 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7798783 Time: 0.021172 [05/21/2021-05:47:51] [V] [TRT] Tactic: 8191999 Time: 0.023588 [05/21/2021-05:47:51] [V] [TRT] Tactic: 8257535 Time: 0.019728 [05/21/2021-05:47:51] [V] [TRT] Tactic: 8323071 Time: 0.021016 [05/21/2021-05:47:51] [V] [TRT] Tactic: 8650751 Time: 0.020832 [05/21/2021-05:47:51] [V] [TRT] Tactic: 8716287 Time: 0.022564 [05/21/2021-05:47:51] [V] [TRT] Tactic: 9109503 Time: 0.021544 [05/21/2021-05:47:51] [V] [TRT] Tactic: 9568255 Time: 0.01846 [05/21/2021-05:47:51] [V] [TRT] Tactic: 9895935 Time: 0.018432 [05/21/2021-05:47:51] [V] [TRT] Tactic: 10223615 Time: 0.02868 [05/21/2021-05:47:51] [V] [TRT] Tactic: 10354687 Time: 0.017952 [05/21/2021-05:47:51] [V] [TRT] Tactic: 10551295 Time: 0.022528 [05/21/2021-05:47:51] [V] [TRT] Tactic: 10747903 Time: 0.017408 [05/21/2021-05:47:51] [V] [TRT] Tactic: 10944511 Time: 0.020224 [05/21/2021-05:47:51] [V] [TRT] Fastest Tactic: 10747903 Time: 0.017408 [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:51] [V] [TRT] Tactic: 2195670545862694453 Time: 0.020024 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:51] [V] [TRT] Tactic: 3891805945559659536 Time: 0.02496 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:47:51] [V] [TRT] Tactic: 4418200634486186714 Time: 0.017156 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:51] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01832 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:51] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017792 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:47:51] [V] [TRT] Tactic: 7392644644614664811 Time: 0.018432 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:47:51] [V] [TRT] Tactic: -4884039206922900293 Time: 0.024216 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:51] [V] [TRT] Tactic: -4374269919094467161 Time: 0.018868 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:51] [V] [TRT] Tactic: -1546027692247304867 Time: 0.024864 [05/21/2021-05:47:51] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.017156 [05/21/2021-05:47:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:47:51] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(401408,3136,56,1) *************** [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(50176,1:8,896,16) *************** [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:47:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:51] [V] [TRT] Tactic: 0 Time: 0.049664 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1 Time: 0.039936 [05/21/2021-05:47:51] [V] [TRT] Tactic: 2 Time: 0.111744 [05/21/2021-05:47:51] [V] [TRT] Tactic: 56 Time: 0.050176 [05/21/2021-05:47:51] [V] [TRT] Tactic: 58 Time: 0.112128 [05/21/2021-05:47:51] [V] [TRT] Fastest Tactic: 1 Time: 0.039936 [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:51] [V] [TRT] Tactic: 254850674756030979 Time: 0.017152 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1156328698016730421 Time: 0.012212 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1362727228442059924 Time: 0.013056 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1576319725282257846 Time: 0.010348 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1832046141070096030 Time: 0.010056 [05/21/2021-05:47:51] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:51] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009984 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:52] [V] [TRT] Tactic: 1899296423087490472 Time: 0.012288 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:47:52] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009472 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:52] [V] [TRT] Tactic: 2541579301352125276 Time: 0.011264 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:47:52] [V] [TRT] Tactic: 2559328254295148085 Time: 0.015368 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:52] [V] [TRT] Tactic: 2657157263811141609 Time: 0.013604 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:52] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009544 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3071479995783211391 Time: 0.013352 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010272 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3362537467505018070 Time: 0.011568 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3513075359009385578 Time: 0.017408 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3704534001553878387 Time: 0.012116 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:47:52] [V] [TRT] Tactic: 3899310434460415852 Time: 0.011136 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009984 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4370476717970497892 Time: 0.009604 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0082 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4491683531415781597 Time: 0.015452 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01074 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4571819373777460444 Time: 0.016384 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4595173549602041350 Time: 0.015348 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01344 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:47:52] [V] [TRT] Tactic: 4993757826442493905 Time: 0.009216 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:52] [V] [TRT] Tactic: 5059676457552313631 Time: 0.016852 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:47:52] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011864 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:47:52] [V] [TRT] Tactic: 5346855796032465921 Time: 0.012952 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:52] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012672 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:52] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009348 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:52] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011984 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:52] [V] [TRT] Tactic: 6468794451065529747 Time: 0.010288 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:47:52] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00844 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:52] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011392 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:52] [V] [TRT] Tactic: 7216571380637776659 Time: 0.012572 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:52] [V] [TRT] Tactic: 7609923741161019135 Time: 0.009984 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:52] [V] [TRT] Tactic: 8101703987960976805 Time: 0.013184 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:52] [V] [TRT] Tactic: 8170606396342855895 Time: 0.010588 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:47:52] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012536 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:47:52] [V] [TRT] Tactic: 8823554289762712606 Time: 0.009188 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:52] [V] [TRT] Tactic: 8839784824303350101 Time: 0.013104 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:47:52] [V] [TRT] Tactic: -9203179519031456182 Time: 0.009884 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:52] [V] [TRT] Tactic: -9009272790678027912 Time: 0.01344 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:52] [V] [TRT] Tactic: -8604374562669615024 Time: 0.012216 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:47:52] [V] [TRT] Tactic: -8280443484414412687 Time: 0.016372 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:47:52] [V] [TRT] Tactic: -8205952393017864204 Time: 0.01544 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:47:52] [V] [TRT] Tactic: -8131857373260504832 Time: 0.008396 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:47:52] [V] [TRT] Tactic: -7410012245391920273 Time: 0.012388 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:47:52] [V] [TRT] Tactic: -7099920365135295801 Time: 0.00852 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:47:52] [V] [TRT] Tactic: -7089118800560870395 Time: 0.011316 [05/21/2021-05:47:52] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:47:53] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01218 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:47:53] [V] [TRT] Tactic: -6356316196810535311 Time: 0.013696 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:47:53] [V] [TRT] Tactic: -6063766379489217211 Time: 0.010008 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:47:53] [V] [TRT] Tactic: -5530886555766748586 Time: 0.011528 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:47:53] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00976 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:47:53] [V] [TRT] Tactic: -5161596964442251102 Time: 0.010112 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:47:53] [V] [TRT] Tactic: -5127240325355316006 Time: 0.009272 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4950923835688973492 Time: 0.011776 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01038 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0127 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008448 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4293222705763522367 Time: 0.011384 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4152066959007262150 Time: 0.016384 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:47:53] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009216 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3987638434926559037 Time: 0.010548 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0128 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012424 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01286 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3601464762214218301 Time: 0.01294 [05/21/2021-05:47:53] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:47:53] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011388 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:47:54] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0124 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:47:54] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011248 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:47:54] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012304 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:47:54] [V] [TRT] Tactic: -2032577876140256150 Time: 0.010368 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:47:54] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00896 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1985778916402815946 Time: 0.013464 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1828674067637788567 Time: 0.013656 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009732 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1562548049711204899 Time: 0.012272 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009516 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011892 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:47:54] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009216 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:47:54] [V] [TRT] Tactic: -406984317033388136 Time: 0.01124 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:47:54] [V] [TRT] Tactic: -331499326992534460 Time: 0.009364 [05/21/2021-05:47:54] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:47:54] [V] [TRT] Tactic: -206523504474952360 Time: 0.012656 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 4480294673430783793 Time: 0.0082 [05/21/2021-05:47:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4480294673430783793 [05/21/2021-05:47:54] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(25088,1:16,448,8) *************** [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution) [05/21/2021-05:47:54] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution) [05/21/2021-05:47:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution) [05/21/2021-05:47:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.01172 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.009268 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.009268 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.011896 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.00932 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00932 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.009568 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.007604 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.007604 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.009856 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.005576 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.005576 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.008404 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.005776 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.005776 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.008392 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.00886 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.008392 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.011296 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.008448 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.008448 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.006272 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.008204 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.008488 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.008204 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:54] [V] [TRT] Tactic: 1002 Time: 0.008352 [05/21/2021-05:47:54] [V] [TRT] Tactic: 0 Time: 0.008952 [05/21/2021-05:47:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.008352 [05/21/2021-05:47:54] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007464 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007304 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007304 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007468 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007024 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007024 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.012632 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.0096 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0096 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.013184 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007432 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007432 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00868 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.009344 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00868 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00908 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00964 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00908 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.0078 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007156 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007156 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009392 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007156 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007156 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.009076 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007936 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.009192 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007936 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.011648 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009612 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009404 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.009196 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.009196 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.011008 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.005512 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005512 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009116 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007312 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007312 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00896 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.008064 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.008064 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.015144 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00836 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00486 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.008296 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.006528 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.006528 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.008232 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.01282 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.005144 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005144 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009236 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.004888 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.004888 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(25088,1:16,448,8) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00728 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00728 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.010116 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00934 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00934 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(401408,1,7168,128) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00776 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007284 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007284 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(100352,1:4,1792,32) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.007848 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(401408,3136,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.012404 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.009224 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.009224 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(200704,3136:2,56,1) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.009344 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.00876 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00876 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(50176,1:8,896,16) (Reformat) [05/21/2021-05:47:55] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00704 [05/21/2021-05:47:55] [V] [TRT] *************** Autotuning format combination: Float(401408,3136,56,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:47:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:47:55] [V] [TRT] Tactic: 458751 Time: 0.06848 [05/21/2021-05:47:55] [V] [TRT] Fastest Tactic: 458751 Time: 0.06848 [05/21/2021-05:47:55] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:55] [V] [TRT] Tactic: 0 Time: 0.062112 [05/21/2021-05:47:56] [V] [TRT] Tactic: 1 Time: 0.044544 [05/21/2021-05:47:56] [V] [TRT] Tactic: 2 Time: 0.13824 [05/21/2021-05:47:56] [V] [TRT] Tactic: 5 Time: 0.487556 [05/21/2021-05:47:56] [V] [TRT] Tactic: 56 Time: 0.068008 [05/21/2021-05:47:56] [V] [TRT] Tactic: 57 Time: 0.043188 [05/21/2021-05:47:56] [V] [TRT] Tactic: 58 Time: 0.137556 [05/21/2021-05:47:56] [V] [TRT] Tactic: 61 Time: 0.487028 [05/21/2021-05:47:56] [V] [TRT] Tactic: 112 Time: 0.060892 [05/21/2021-05:47:56] [V] [TRT] Tactic: 113 Time: 0.068592 [05/21/2021-05:47:56] [V] [TRT] Tactic: 114 Time: 0.1376 [05/21/2021-05:47:56] [V] [TRT] Tactic: 117 Time: 0.48726 [05/21/2021-05:47:56] [V] [TRT] Fastest Tactic: 57 Time: 0.043188 [05/21/2021-05:47:56] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4549827808004681195 Time: 0.101248 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:47:56] [V] [TRT] Tactic: 5779835512569528575 Time: 0.129304 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:47:56] [V] [TRT] Tactic: 6053873026024413720 Time: 0.1305 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:47:56] [V] [TRT] Tactic: 6767548733843469815 Time: 0.10206 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:47:56] [V] [TRT] Tactic: -6313876406580483184 Time: 0.126292 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:47:56] [V] [TRT] Tactic: -1123676555321336786 Time: 0.131084 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:47:56] [V] [TRT] Tactic: -701551393537224327 Time: 0.113664 [05/21/2021-05:47:56] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.101248 [05/21/2021-05:47:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 57 [05/21/2021-05:47:56] [V] [TRT] *************** Autotuning format combination: Float(401408,1,7168,128) -> Float(100352,1,3584,128) *************** [05/21/2021-05:47:56] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:56] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:56] [V] [TRT] Tactic: 2860655430572478466 Time: 0.077092 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4474630279712975759 Time: 0.044024 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043672 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4696204239951173149 Time: 0.077276 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:56] [V] [TRT] Tactic: 5778138195697110003 Time: 0.137368 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:47:56] [V] [TRT] Tactic: 7155825427510256858 Time: 0.126592 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:56] [V] [TRT] Tactic: 8918020581761223752 Time: 0.123664 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:47:56] [V] [TRT] Tactic: -4756382386362004279 Time: 0.07552 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:56] [V] [TRT] Tactic: -3855385237722507464 Time: 0.137988 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:56] [V] [TRT] Tactic: -2809379259463049391 Time: 0.136352 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:56] [V] [TRT] Tactic: -504296718212024303 Time: 0.127452 [05/21/2021-05:47:56] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043672 [05/21/2021-05:47:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:56] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,1792,32) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:47:56] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:56] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:47:56] [V] [TRT] Tactic: 2860655430572478466 Time: 0.078464 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4474630279712975759 Time: 0.044832 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043776 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:47:56] [V] [TRT] Tactic: 4696204239951173149 Time: 0.07744 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:47:56] [V] [TRT] Tactic: 5778138195697110003 Time: 0.137216 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:47:56] [V] [TRT] Tactic: 7155825427510256858 Time: 0.126556 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:47:56] [V] [TRT] Tactic: 7342025736444949634 Time: 0.091132 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:47:56] [V] [TRT] Tactic: 8918020581761223752 Time: 0.123 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:47:56] [V] [TRT] Tactic: -7377458734869418330 Time: 0.085928 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:47:56] [V] [TRT] Tactic: -5457304872213719461 Time: 0.0876 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:47:56] [V] [TRT] Tactic: -4756382386362004279 Time: 0.07672 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:47:56] [V] [TRT] Tactic: -3855385237722507464 Time: 0.138528 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:47:56] [V] [TRT] Tactic: -2809379259463049391 Time: 0.135936 [05/21/2021-05:47:56] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:47:57] [V] [TRT] Tactic: -504296718212024303 Time: 0.124928 [05/21/2021-05:47:57] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043776 [05/21/2021-05:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:47:57] [V] [TRT] *************** Autotuning format combination: Half(401408,3136,56,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:57] [V] [TRT] Tactic: 0 Time: 0.06336 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1 Time: 0.062988 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2 Time: 0.081512 [05/21/2021-05:47:57] [V] [TRT] Tactic: 5 Time: 0.484772 [05/21/2021-05:47:57] [V] [TRT] Tactic: 56 Time: 0.06272 [05/21/2021-05:47:57] [V] [TRT] Tactic: 58 Time: 0.082084 [05/21/2021-05:47:57] [V] [TRT] Tactic: 61 Time: 0.48406 [05/21/2021-05:47:57] [V] [TRT] Fastest Tactic: 56 Time: 0.06272 [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56 [05/21/2021-05:47:57] [V] [TRT] *************** Autotuning format combination: Half(200704,3136:2,56,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:47:57] [V] [TRT] Tactic: 458751 Time: 0.043008 [05/21/2021-05:47:57] [V] [TRT] Fastest Tactic: 458751 Time: 0.043008 [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2195670545862694453 Time: 0.065664 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:47:57] [V] [TRT] Tactic: 3419182076704469245 Time: 0.060672 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:47:57] [V] [TRT] Tactic: 3891805945559659536 Time: 0.085032 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:47:57] [V] [TRT] Tactic: 5548126322150286555 Time: 0.058764 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:47:57] [V] [TRT] Tactic: 6057304366605292508 Time: 0.053392 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:47:57] [V] [TRT] Tactic: -7928611605886347652 Time: 0.08806 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:47:57] [V] [TRT] Tactic: -5172391392092686714 Time: 0.065408 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:47:57] [V] [TRT] Tactic: -4374269919094467161 Time: 0.052656 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:47:57] [V] [TRT] Tactic: -1546027692247304867 Time: 0.085756 [05/21/2021-05:47:57] [V] [TRT] Fastest Tactic: -4374269919094467161 Time: 0.052656 [05/21/2021-05:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [05/21/2021-05:47:57] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,896,16) -> Float(100352,784,28,1) *************** [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:57] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,896,16) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:47:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:47:57] [V] [TRT] Tactic: 0 Time: 0.088144 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1 Time: 0.087808 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2 Time: 0.13008 [05/21/2021-05:47:57] [V] [TRT] Tactic: 56 Time: 0.087312 [05/21/2021-05:47:57] [V] [TRT] Tactic: 58 Time: 0.131968 [05/21/2021-05:47:57] [V] [TRT] Fastest Tactic: 56 Time: 0.087312 [05/21/2021-05:47:57] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:47:57] [V] [TRT] Tactic: 254850674756030979 Time: 0.04704 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:47:57] [V] [TRT] Tactic: 328038211831149625 Time: 0.046308 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:47:57] [V] [TRT] Tactic: 411553864378931917 Time: 0.016384 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1011057357468998345 Time: 0.028416 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1156328698016730421 Time: 0.028672 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1723736032573714698 Time: 0.01526 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0165 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1838082074606840426 Time: 0.017412 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:47:57] [V] [TRT] Tactic: 1899296423087490472 Time: 0.011792 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2428167804343994714 Time: 0.016528 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2541579301352125276 Time: 0.026956 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01182 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2819719497590964443 Time: 0.016896 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2968605903460894194 Time: 0.01664 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:47:57] [V] [TRT] Tactic: 2986078304285316765 Time: 0.027768 [05/21/2021-05:47:57] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:47:58] [V] [TRT] Tactic: 3362537467505018070 Time: 0.026512 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:47:58] [V] [TRT] Tactic: 3513075359009385578 Time: 0.048256 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:47:58] [V] [TRT] Tactic: 3573559043797674382 Time: 0.016472 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:47:58] [V] [TRT] Tactic: 3591970081995419777 Time: 0.010228 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:47:58] [V] [TRT] Tactic: 3704534001553878387 Time: 0.026752 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:47:58] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01654 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:47:58] [V] [TRT] Tactic: 4503233883285355107 Time: 0.0128 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:47:58] [V] [TRT] Tactic: 4802447371470387646 Time: 0.03068 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5059676457552313631 Time: 0.046336 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5368829646735632944 Time: 0.011392 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5398999388616959893 Time: 0.027688 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5746691132547383910 Time: 0.01668 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5770170567977052602 Time: 0.032044 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:47:58] [V] [TRT] Tactic: 5953552212833506549 Time: 0.0256 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6034364043891107501 Time: 0.015476 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6074229447555668232 Time: 0.011384 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6154447660803990543 Time: 0.017436 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6325769668000961702 Time: 0.027172 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6350273239113254096 Time: 0.010496 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6377497238381488891 Time: 0.026368 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:47:58] [V] [TRT] Tactic: 6446388116965632819 Time: 0.017172 [05/21/2021-05:47:58] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:47:59] [V] [TRT] Tactic: 6468794451065529747 Time: 0.016744 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:47:59] [V] [TRT] Tactic: 6642277870194067185 Time: 0.048768 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:47:59] [V] [TRT] Tactic: 6859477213531075460 Time: 0.01138 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:47:59] [V] [TRT] Tactic: 6972489290272968208 Time: 0.025592 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:47:59] [V] [TRT] Tactic: 6979044990896381511 Time: 0.045172 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:47:59] [V] [TRT] Tactic: 7216571380637776659 Time: 0.034304 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:47:59] [V] [TRT] Tactic: 7609923741161019135 Time: 0.016536 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:47:59] [V] [TRT] Tactic: 7705739241028240201 Time: 0.012132 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:47:59] [V] [TRT] Tactic: 8072087735545283117 Time: 0.04704 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:47:59] [V] [TRT] Tactic: 8101703987960976805 Time: 0.012248 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:47:59] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01712 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:47:59] [V] [TRT] Tactic: 8839784824303350101 Time: 0.031544 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:47:59] [V] [TRT] Tactic: -9217371357561775773 Time: 0.01216 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:47:59] [V] [TRT] Tactic: -9009272790678027912 Time: 0.032256 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:47:59] [V] [TRT] Tactic: -8985224497679592364 Time: 0.013712 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:47:59] [V] [TRT] Tactic: -8949544755481315679 Time: 0.0171 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:47:59] [V] [TRT] Tactic: -8759929675070720385 Time: 0.02688 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:47:59] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01152 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:47:59] [V] [TRT] Tactic: -6902925267326201166 Time: 0.010116 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:47:59] [V] [TRT] Tactic: -6840588038605932325 Time: 0.016372 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:47:59] [V] [TRT] Tactic: -6799856376604253964 Time: 0.046164 [05/21/2021-05:47:59] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6625722781282978136 Time: 0.016416 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6525498856028268801 Time: 0.0256 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012416 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6324345858751792783 Time: 0.018128 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6262400699544994312 Time: 0.045732 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6257787336162086472 Time: 0.029484 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:00] [V] [TRT] Tactic: -6063766379489217211 Time: 0.016592 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5777580938094193096 Time: 0.016384 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5657273398217409378 Time: 0.04736 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5530886555766748586 Time: 0.026624 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5422685219138380548 Time: 0.015308 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5161596964442251102 Time: 0.016384 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:00] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01538 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4825567853927730435 Time: 0.0169 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4796511246675321840 Time: 0.016688 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4706569565442112734 Time: 0.01258 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4566599693570369588 Time: 0.02688 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4409144516525410768 Time: 0.026624 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4379519430184503304 Time: 0.015872 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4152066959007262150 Time: 0.04738 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:00] [V] [TRT] Tactic: -4021926646879732549 Time: 0.016284 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3987638434926559037 Time: 0.016616 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3905653247016903130 Time: 0.02808 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3903974568488493144 Time: 0.017 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3895429239811098010 Time: 0.016128 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3864869056275745423 Time: 0.030444 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011296 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3412636942650049698 Time: 0.028536 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3338665856053412950 Time: 0.026984 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:00] [V] [TRT] Tactic: -3058330359340425555 Time: 0.016412 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:48:00] [V] [TRT] Tactic: -2816084650627734155 Time: 0.03284 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:48:00] [V] [TRT] Tactic: -2662892962457732243 Time: 0.01536 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:48:00] [V] [TRT] Tactic: -2559894581585337900 Time: 0.04672 [05/21/2021-05:48:00] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:48:01] [V] [TRT] Tactic: -2530740716768816092 Time: 0.026496 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:48:01] [V] [TRT] Tactic: -2332828394978346992 Time: 0.027036 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:48:01] [V] [TRT] Tactic: -2241736083352441442 Time: 0.03374 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:48:01] [V] [TRT] Tactic: -2161909437867201546 Time: 0.01072 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:01] [V] [TRT] Tactic: -1985778916402815946 Time: 0.031284 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:48:01] [V] [TRT] Tactic: -1500496213132463076 Time: 0.017408 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:01] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011376 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:48:01] [V] [TRT] Tactic: -910286698936744682 Time: 0.01024 [05/21/2021-05:48:01] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:48:01] [V] [TRT] Tactic: -606726295133751039 Time: 0.016768 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.010116 [05/21/2021-05:48:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166 [05/21/2021-05:48:01] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,448,8) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.010396 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.0051 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0051 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.010112 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.005112 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006372 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.00652 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004108 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004108 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.008704 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007452 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00584 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00584 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007312 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.01136 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.005816 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005816 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007936 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00444 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00444 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007092 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.005308 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005308 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.006044 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004212 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004212 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.00526 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00526 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:48:01] [V] [TRT] Tactic: 0 Time: 0.005492 [05/21/2021-05:48:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005492 [05/21/2021-05:48:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:01] [V] [TRT] Tactic: 1002 Time: 0.010056 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.008216 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004236 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004236 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.008272 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.0053 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.0053 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.008216 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004236 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004236 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.00792 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.007136 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004596 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004596 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004084 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004092 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004092 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.007308 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.00418 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00418 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004972 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004972 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.005124 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005124 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.008704 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.003764 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003764 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.003712 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(6272,1:16,224,8) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006628 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004856 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004856 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.0076 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(100352,1,3584,128) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006576 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004696 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004696 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(25088,1:4,896,32) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006016 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004128 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(100352,784,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.005156 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005156 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(50176,784:2,28,1) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.006152 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.006152 [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(12544,1:8,448,16) (Reformat) [05/21/2021-05:48:02] [V] [TRT] Tactic: 1002 Time: 0.006564 [05/21/2021-05:48:02] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:02] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:48:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:02] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:48:02] [V] [TRT] Tactic: 589823 Time: 0.041252 [05/21/2021-05:48:02] [V] [TRT] Tactic: 655359 Time: 0.033792 [05/21/2021-05:48:02] [V] [TRT] Tactic: 786431 Time: 0.025804 [05/21/2021-05:48:02] [V] [TRT] Tactic: 851967 Time: 0.027868 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1179647 Time: 0.024576 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1310719 Time: 0.02778 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1376255 Time: 0.034432 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1441791 Time: 0.025344 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1507327 Time: 0.0256 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1638399 Time: 0.025252 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1835007 Time: 0.031548 [05/21/2021-05:48:02] [V] [TRT] Tactic: 1900543 Time: 0.03392 [05/21/2021-05:48:02] [V] [TRT] Tactic: 2097151 Time: 0.0255 [05/21/2021-05:48:02] [V] [TRT] Tactic: 2162687 Time: 0.034044 [05/21/2021-05:48:02] [V] [TRT] Tactic: 2293759 Time: 0.033624 [05/21/2021-05:48:02] [V] [TRT] Tactic: 2359295 Time: 0.025856 [05/21/2021-05:48:02] [V] [TRT] Tactic: 2686975 Time: 0.031936 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3080191 Time: 0.025456 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3342335 Time: 0.025584 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3407871 Time: 0.027392 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3538943 Time: 0.027524 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3670015 Time: 0.048136 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3932159 Time: 0.031896 [05/21/2021-05:48:02] [V] [TRT] Tactic: 3997695 Time: 0.025596 [05/21/2021-05:48:02] [V] [TRT] Tactic: 4063231 Time: 0.023424 [05/21/2021-05:48:02] [V] [TRT] Tactic: 4194303 Time: 0.023552 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4259839 Time: 0.024148 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4325375 Time: 0.024524 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4521983 Time: 0.031616 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4587519 Time: 0.025856 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4653055 Time: 0.02442 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4915199 Time: 0.024668 [05/21/2021-05:48:03] [V] [TRT] Tactic: 4980735 Time: 0.025472 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5177343 Time: 0.02496 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5242879 Time: 0.026368 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5373951 Time: 0.027624 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5439487 Time: 0.030408 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5570559 Time: 0.024872 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5636095 Time: 0.023348 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5701631 Time: 0.030796 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5767167 Time: 0.042656 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5832703 Time: 0.025884 [05/21/2021-05:48:03] [V] [TRT] Tactic: 5898239 Time: 0.023168 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6029311 Time: 0.03072 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6225919 Time: 0.02368 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6291455 Time: 0.024068 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6422527 Time: 0.026752 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6750207 Time: 0.028672 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6815743 Time: 0.027664 [05/21/2021-05:48:03] [V] [TRT] Tactic: 6946815 Time: 0.033468 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7012351 Time: 0.025452 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7077887 Time: 0.024296 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7143423 Time: 0.037008 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7208959 Time: 0.026288 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7340031 Time: 0.023808 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7405567 Time: 0.022964 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7536639 Time: 0.03136 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7602175 Time: 0.03008 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7733247 Time: 0.02358 [05/21/2021-05:48:03] [V] [TRT] Tactic: 7798783 Time: 0.025512 [05/21/2021-05:48:03] [V] [TRT] Tactic: 8191999 Time: 0.030628 [05/21/2021-05:48:03] [V] [TRT] Tactic: 8257535 Time: 0.024952 [05/21/2021-05:48:03] [V] [TRT] Tactic: 8323071 Time: 0.027556 [05/21/2021-05:48:03] [V] [TRT] Tactic: 8650751 Time: 0.02606 [05/21/2021-05:48:03] [V] [TRT] Tactic: 8716287 Time: 0.0256 [05/21/2021-05:48:03] [V] [TRT] Tactic: 9109503 Time: 0.025448 [05/21/2021-05:48:04] [V] [TRT] Tactic: 9568255 Time: 0.024832 [05/21/2021-05:48:04] [V] [TRT] Tactic: 9895935 Time: 0.024116 [05/21/2021-05:48:04] [V] [TRT] Tactic: 10223615 Time: 0.032572 [05/21/2021-05:48:04] [V] [TRT] Tactic: 10354687 Time: 0.026 [05/21/2021-05:48:04] [V] [TRT] Tactic: 10551295 Time: 0.0288 [05/21/2021-05:48:04] [V] [TRT] Tactic: 10747903 Time: 0.023412 [05/21/2021-05:48:04] [V] [TRT] Tactic: 10944511 Time: 0.024616 [05/21/2021-05:48:04] [V] [TRT] Fastest Tactic: 7405567 Time: 0.022964 [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:04] [V] [TRT] Tactic: 0 Time: 0.024576 [05/21/2021-05:48:04] [V] [TRT] Tactic: 1 Time: 0.02112 [05/21/2021-05:48:04] [V] [TRT] Tactic: 2 Time: 0.050164 [05/21/2021-05:48:04] [V] [TRT] Tactic: 4 Time: 0.741672 [05/21/2021-05:48:04] [V] [TRT] Tactic: 5 Time: 0.067704 [05/21/2021-05:48:04] [V] [TRT] Tactic: 56 Time: 0.025668 [05/21/2021-05:48:04] [V] [TRT] Tactic: 57 Time: 0.02318 [05/21/2021-05:48:04] [V] [TRT] Tactic: 58 Time: 0.051216 [05/21/2021-05:48:04] [V] [TRT] Tactic: 60 Time: 0.74044 [05/21/2021-05:48:04] [V] [TRT] Tactic: 61 Time: 0.068028 [05/21/2021-05:48:04] [V] [TRT] Tactic: 112 Time: 0.025856 [05/21/2021-05:48:04] [V] [TRT] Tactic: 113 Time: 0.025732 [05/21/2021-05:48:04] [V] [TRT] Tactic: 114 Time: 0.050972 [05/21/2021-05:48:04] [V] [TRT] Tactic: 116 Time: 0.740416 [05/21/2021-05:48:04] [V] [TRT] Tactic: 117 Time: 0.067524 [05/21/2021-05:48:04] [V] [TRT] Fastest Tactic: 1 Time: 0.02112 [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:04] [V] [TRT] Tactic: 4549827808004681195 Time: 0.019036 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:04] [V] [TRT] Tactic: 5779835512569528575 Time: 0.021848 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:04] [V] [TRT] Tactic: 9151672657204310840 Time: 0.027168 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:04] [V] [TRT] Tactic: -7491730084094677098 Time: 0.020776 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:48:04] [V] [TRT] Tactic: -6622064180404051845 Time: 0.028976 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:04] [V] [TRT] Tactic: -6313876406580483184 Time: 0.02262 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:04] [V] [TRT] Tactic: -6273689210331812572 Time: 0.022436 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:04] [V] [TRT] Tactic: -4337126844824617177 Time: 0.018364 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:04] [V] [TRT] Tactic: -1123676555321336786 Time: 0.022656 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:04] [V] [TRT] Tactic: -701551393537224327 Time: 0.019752 [05/21/2021-05:48:04] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.018364 [05/21/2021-05:48:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177 [05/21/2021-05:48:04] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:04] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:04] [V] [TRT] Tactic: 1663866669559596164 Time: 0.02176 [05/21/2021-05:48:04] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:05] [V] [TRT] Tactic: 2860655430572478466 Time: 0.014848 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017024 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016416 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4696204239951173149 Time: 0.014336 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:05] [V] [TRT] Tactic: 5778138195697110003 Time: 0.022548 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:05] [V] [TRT] Tactic: 8918020581761223752 Time: 0.020616 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:05] [V] [TRT] Tactic: -5905193483742532701 Time: 0.014464 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:05] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016896 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:05] [V] [TRT] Tactic: -2809379259463049391 Time: 0.022152 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:05] [V] [TRT] Tactic: -1985235291706575900 Time: 0.02088 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:05] [V] [TRT] Tactic: -504296718212024303 Time: 0.02062 [05/21/2021-05:48:05] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.014336 [05/21/2021-05:48:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149 [05/21/2021-05:48:05] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:05] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1373022415249282411 Time: 0.01836 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1663866669559596164 Time: 0.021888 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:05] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015512 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4474630279712975759 Time: 0.016896 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016524 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4696204239951173149 Time: 0.014464 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:05] [V] [TRT] Tactic: 5778138195697110003 Time: 0.021504 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:05] [V] [TRT] Tactic: 8918020581761223752 Time: 0.020992 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:48:05] [V] [TRT] Tactic: -7067026478815706014 Time: 0.018304 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:05] [V] [TRT] Tactic: -5905193483742532701 Time: 0.014464 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:05] [V] [TRT] Tactic: -4035591156787122265 Time: 0.017072 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:05] [V] [TRT] Tactic: -2809379259463049391 Time: 0.022048 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:05] [V] [TRT] Tactic: -1985235291706575900 Time: 0.020536 [05/21/2021-05:48:05] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:05] [V] [TRT] Tactic: -504296718212024303 Time: 0.020736 [05/21/2021-05:48:05] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.014464 [05/21/2021-05:48:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149 [05/21/2021-05:48:05] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:05] [V] [TRT] Tactic: 0 Time: 0.015836 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1 Time: 0.015992 [05/21/2021-05:48:05] [V] [TRT] Tactic: 2 Time: 0.048384 [05/21/2021-05:48:05] [V] [TRT] Tactic: 4 Time: 0.740336 [05/21/2021-05:48:05] [V] [TRT] Tactic: 5 Time: 0.0668 [05/21/2021-05:48:05] [V] [TRT] Tactic: 56 Time: 0.01548 [05/21/2021-05:48:05] [V] [TRT] Tactic: 58 Time: 0.049952 [05/21/2021-05:48:05] [V] [TRT] Tactic: 60 Time: 0.739712 [05/21/2021-05:48:05] [V] [TRT] Tactic: 61 Time: 0.067444 [05/21/2021-05:48:05] [V] [TRT] Fastest Tactic: 56 Time: 0.01548 [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56 [05/21/2021-05:48:05] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:05] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:05] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:48:05] [V] [TRT] Tactic: 589823 Time: 0.023704 [05/21/2021-05:48:05] [V] [TRT] Tactic: 655359 Time: 0.020472 [05/21/2021-05:48:05] [V] [TRT] Tactic: 786431 Time: 0.015608 [05/21/2021-05:48:05] [V] [TRT] Tactic: 851967 Time: 0.016684 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1179647 Time: 0.01472 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1310719 Time: 0.017408 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1376255 Time: 0.019632 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1441791 Time: 0.014208 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1507327 Time: 0.01536 [05/21/2021-05:48:05] [V] [TRT] Tactic: 1638399 Time: 0.014472 [05/21/2021-05:48:06] [V] [TRT] Tactic: 1835007 Time: 0.01856 [05/21/2021-05:48:06] [V] [TRT] Tactic: 1900543 Time: 0.02104 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2097151 Time: 0.015992 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2162687 Time: 0.020504 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2293759 Time: 0.020032 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2359295 Time: 0.015788 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2686975 Time: 0.019568 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3080191 Time: 0.015552 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3342335 Time: 0.016112 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3407871 Time: 0.016648 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3538943 Time: 0.015948 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3670015 Time: 0.029136 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3932159 Time: 0.018376 [05/21/2021-05:48:06] [V] [TRT] Tactic: 3997695 Time: 0.01562 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4063231 Time: 0.014208 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4194303 Time: 0.01432 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4259839 Time: 0.01528 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4325375 Time: 0.01408 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4521983 Time: 0.0194 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4587519 Time: 0.014668 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4653055 Time: 0.014976 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4915199 Time: 0.014336 [05/21/2021-05:48:06] [V] [TRT] Tactic: 4980735 Time: 0.014416 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5177343 Time: 0.014336 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5242879 Time: 0.01536 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5373951 Time: 0.015444 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5439487 Time: 0.01728 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5570559 Time: 0.015616 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5636095 Time: 0.014384 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5701631 Time: 0.018688 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5767167 Time: 0.024092 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5832703 Time: 0.016172 [05/21/2021-05:48:06] [V] [TRT] Tactic: 5898239 Time: 0.014516 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6029311 Time: 0.018928 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6225919 Time: 0.014572 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6291455 Time: 0.01472 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6422527 Time: 0.016004 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6750207 Time: 0.017136 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6815743 Time: 0.016656 [05/21/2021-05:48:06] [V] [TRT] Tactic: 6946815 Time: 0.019328 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7012351 Time: 0.01534 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7077887 Time: 0.0144 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7143423 Time: 0.02068 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7208959 Time: 0.015368 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7340031 Time: 0.014236 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7405567 Time: 0.013712 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7536639 Time: 0.018432 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7602175 Time: 0.016828 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7733247 Time: 0.013312 [05/21/2021-05:48:06] [V] [TRT] Tactic: 7798783 Time: 0.01536 [05/21/2021-05:48:06] [V] [TRT] Tactic: 8191999 Time: 0.017408 [05/21/2021-05:48:06] [V] [TRT] Tactic: 8257535 Time: 0.014388 [05/21/2021-05:48:06] [V] [TRT] Tactic: 8323071 Time: 0.01536 [05/21/2021-05:48:06] [V] [TRT] Tactic: 8650751 Time: 0.014592 [05/21/2021-05:48:06] [V] [TRT] Tactic: 8716287 Time: 0.015844 [05/21/2021-05:48:06] [V] [TRT] Tactic: 9109503 Time: 0.015644 [05/21/2021-05:48:06] [V] [TRT] Tactic: 9568255 Time: 0.014772 [05/21/2021-05:48:06] [V] [TRT] Tactic: 9895935 Time: 0.014348 [05/21/2021-05:48:06] [V] [TRT] Tactic: 10223615 Time: 0.019604 [05/21/2021-05:48:06] [V] [TRT] Tactic: 10354687 Time: 0.014708 [05/21/2021-05:48:06] [V] [TRT] Tactic: 10551295 Time: 0.017544 [05/21/2021-05:48:06] [V] [TRT] Tactic: 10747903 Time: 0.013952 [05/21/2021-05:48:06] [V] [TRT] Tactic: 10944511 Time: 0.01536 [05/21/2021-05:48:06] [V] [TRT] Fastest Tactic: 7733247 Time: 0.013312 [05/21/2021-05:48:06] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:06] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:06] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:06] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:06] [V] [TRT] Tactic: 2195670545862694453 Time: 0.012836 [05/21/2021-05:48:06] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3891805945559659536 Time: 0.01536 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4418200634486186714 Time: 0.012372 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:07] [V] [TRT] Tactic: 5548126322150286555 Time: 0.013052 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:07] [V] [TRT] Tactic: 6057304366605292508 Time: 0.01254 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:07] [V] [TRT] Tactic: 7392644644614664811 Time: 0.01296 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:07] [V] [TRT] Tactic: -4884039206922900293 Time: 0.015872 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:07] [V] [TRT] Tactic: -4374269919094467161 Time: 0.013284 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:07] [V] [TRT] Tactic: -1546027692247304867 Time: 0.01592 [05/21/2021-05:48:07] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.012372 [05/21/2021-05:48:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:48:07] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:07] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:07] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:48:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:07] [V] [TRT] Tactic: 0 Time: 0.024448 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1 Time: 0.022944 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2 Time: 0.05578 [05/21/2021-05:48:07] [V] [TRT] Tactic: 56 Time: 0.025244 [05/21/2021-05:48:07] [V] [TRT] Tactic: 58 Time: 0.056576 [05/21/2021-05:48:07] [V] [TRT] Fastest Tactic: 1 Time: 0.022944 [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:07] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:07] [V] [TRT] Tactic: 254850674756030979 Time: 0.012428 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1156328698016730421 Time: 0.009704 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1362727228442059924 Time: 0.00976 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1576319725282257846 Time: 0.00832 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1832046141070096030 Time: 0.008244 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1838082074606840426 Time: 0.00818 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:07] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0096 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2238656696610018305 Time: 0.007452 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2541579301352125276 Time: 0.008596 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2559328254295148085 Time: 0.01306 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01026 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:07] [V] [TRT] Tactic: 2968605903460894194 Time: 0.008664 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3071479995783211391 Time: 0.01024 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3359475309458902373 Time: 0.008676 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3362537467505018070 Time: 0.00962 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3513075359009385578 Time: 0.012752 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3704534001553878387 Time: 0.009556 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:48:07] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009208 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4278315135102886928 Time: 0.007772 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4370476717970497892 Time: 0.007168 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4480294673430783793 Time: 0.00676 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4491683531415781597 Time: 0.011392 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4528997467275241200 Time: 0.008228 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:07] [V] [TRT] Tactic: 4571819373777460444 Time: 0.012684 [05/21/2021-05:48:07] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:48:08] [V] [TRT] Tactic: 4595173549602041350 Time: 0.012672 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:08] [V] [TRT] Tactic: 4802447371470387646 Time: 0.010208 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:48:08] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00778 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:08] [V] [TRT] Tactic: 5059676457552313631 Time: 0.012532 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:08] [V] [TRT] Tactic: 5205510332404400949 Time: 0.009148 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:08] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011024 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:08] [V] [TRT] Tactic: 5398999388616959893 Time: 0.010228 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:08] [V] [TRT] Tactic: 6034364043891107501 Time: 0.007576 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:08] [V] [TRT] Tactic: 6377497238381488891 Time: 0.009184 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:08] [V] [TRT] Tactic: 6468794451065529747 Time: 0.00832 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:48:08] [V] [TRT] Tactic: 6697277555581639516 Time: 0.006684 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:08] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010396 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:08] [V] [TRT] Tactic: 7216571380637776659 Time: 0.01024 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:08] [V] [TRT] Tactic: 7609923741161019135 Time: 0.008064 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:08] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01048 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:08] [V] [TRT] Tactic: 8170606396342855895 Time: 0.008704 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:08] [V] [TRT] Tactic: 8764780417487154889 Time: 0.009964 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:48:08] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008172 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:08] [V] [TRT] Tactic: 8839784824303350101 Time: 0.00978 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:48:08] [V] [TRT] Tactic: -9203179519031456182 Time: 0.008136 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:08] [V] [TRT] Tactic: -9009272790678027912 Time: 0.010424 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:08] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009216 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:08] [V] [TRT] Tactic: -8280443484414412687 Time: 0.01152 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:08] [V] [TRT] Tactic: -8205952393017864204 Time: 0.011528 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:08] [V] [TRT] Tactic: -8131857373260504832 Time: 0.007156 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:08] [V] [TRT] Tactic: -7410012245391920273 Time: 0.010624 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:08] [V] [TRT] Tactic: -7099920365135295801 Time: 0.007808 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:08] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009344 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:48:08] [V] [TRT] Tactic: -6768327495007644783 Time: 0.009632 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:08] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01088 [05/21/2021-05:48:08] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:08] [V] [TRT] Tactic: -6063766379489217211 Time: 0.008192 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:09] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0096 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:09] [V] [TRT] Tactic: -5409588854490562130 Time: 0.007244 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:09] [V] [TRT] Tactic: -5161596964442251102 Time: 0.008336 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:09] [V] [TRT] Tactic: -5127240325355316006 Time: 0.00768 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009216 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4796511246675321840 Time: 0.008172 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00962 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008064 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4293222705763522367 Time: 0.009216 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4152066959007262150 Time: 0.012516 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:09] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008064 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0085 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3905653247016903130 Time: 0.010376 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3903342530518878192 Time: 0.009196 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3864869056275745423 Time: 0.009236 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008804 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:09] [V] [TRT] Tactic: -3058330359340425555 Time: 0.008436 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:48:09] [V] [TRT] Tactic: -2878731503146438856 Time: 0.01034 [05/21/2021-05:48:09] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:48:10] [V] [TRT] Tactic: -2602982885923184927 Time: 0.009744 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:48:10] [V] [TRT] Tactic: -2353603993968373338 Time: 0.010324 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:48:10] [V] [TRT] Tactic: -2032577876140256150 Time: 0.008576 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:48:10] [V] [TRT] Tactic: -2003055242756584050 Time: 0.007552 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01022 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010212 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1640527254204634147 Time: 0.008108 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1562548049711204899 Time: 0.00832 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1242202084391243207 Time: 0.007144 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009204 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:48:10] [V] [TRT] Tactic: -1038291877007553549 Time: 0.007268 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:48:10] [V] [TRT] Tactic: -406984317033388136 Time: 0.009856 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:48:10] [V] [TRT] Tactic: -331499326992534460 Time: 0.007828 [05/21/2021-05:48:10] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:48:10] [V] [TRT] Tactic: -206523504474952360 Time: 0.010112 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 6697277555581639516 Time: 0.006684 [05/21/2021-05:48:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6697277555581639516 [05/21/2021-05:48:10] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011568 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.010364 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.010364 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011648 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.01024 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011112 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.007636 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007636 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.009728 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.005676 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005676 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008612 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.00576 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008436 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009812 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008436 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011464 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009172 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.009172 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.012288 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.006348 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006348 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009204 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008316 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009564 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008316 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.006976 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006976 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.007308 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007308 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.013028 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009916 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.009916 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.012928 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.007184 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007184 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008956 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009728 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008956 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.009056 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009748 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.009056 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.007712 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.007308 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.0075 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.007308 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011184 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.007292 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.007292 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008812 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.010172 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.008812 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.007524 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009216 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.007524 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.005148 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005148 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.00852 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.006548 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.006548 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.009596 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.009856 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.009596 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.011276 [05/21/2021-05:48:10] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:10] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:10] [V] [TRT] Tactic: 1002 Time: 0.008944 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.008048 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.008048 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.0088 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.00818 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00818 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.01472 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.005288 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005288 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.008904 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007848 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.007848 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.01048 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007808 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.00722 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00722 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007496 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007776 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.007496 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.012176 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.009224 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.004644 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.004644 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007144 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.007144 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.010224 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.009208 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.009208 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007528 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007836 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007936 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.007836 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.012328 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.009344 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.009344 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.0092 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.009224 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0092 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:11] [V] [TRT] Tactic: 1002 Time: 0.007268 [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.007112 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 0 Time: 0.007112 [05/21/2021-05:48:11] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudaDepthwiseConvolution) [05/21/2021-05:48:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (FusedConvActConvolution) [05/21/2021-05:48:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:11] [V] [TRT] Tactic: 0 Time: 0.033948 [05/21/2021-05:48:11] [V] [TRT] Tactic: 1 Time: 0.038236 [05/21/2021-05:48:11] [V] [TRT] Tactic: 2 Time: 0.136412 [05/21/2021-05:48:11] [V] [TRT] Tactic: 56 Time: 0.033024 [05/21/2021-05:48:11] [V] [TRT] Tactic: 57 Time: 0.033792 [05/21/2021-05:48:11] [V] [TRT] Tactic: 58 Time: 0.1325 [05/21/2021-05:48:11] [V] [TRT] Tactic: 112 Time: 0.03338 [05/21/2021-05:48:11] [V] [TRT] Tactic: 113 Time: 0.03446 [05/21/2021-05:48:11] [V] [TRT] Tactic: 114 Time: 0.133504 [05/21/2021-05:48:11] [V] [TRT] Fastest Tactic: 56 Time: 0.033024 [05/21/2021-05:48:11] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:11] [V] [TRT] Tactic: 4549827808004681195 Time: 0.034528 [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:11] [V] [TRT] Tactic: 5779835512569528575 Time: 0.043264 [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:11] [V] [TRT] Tactic: 9151672657204310840 Time: 0.05378 [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:11] [V] [TRT] Tactic: -7491730084094677098 Time: 0.049344 [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:11] [V] [TRT] Tactic: -6313876406580483184 Time: 0.051156 [05/21/2021-05:48:11] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:12] [V] [TRT] Tactic: -6273689210331812572 Time: 0.042668 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:12] [V] [TRT] Tactic: -4337126844824617177 Time: 0.03236 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:12] [V] [TRT] Tactic: -1123676555321336786 Time: 0.042496 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:12] [V] [TRT] Tactic: -701551393537224327 Time: 0.030868 [05/21/2021-05:48:12] [V] [TRT] Fastest Tactic: -701551393537224327 Time: 0.030868 [05/21/2021-05:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -701551393537224327 [05/21/2021-05:48:12] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256), Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:12] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:12] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:12] [V] [TRT] Tactic: 1663866669559596164 Time: 0.03586 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:12] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024184 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02946 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4479823862704990365 Time: 0.028928 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4696204239951173149 Time: 0.027172 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:12] [V] [TRT] Tactic: 5778138195697110003 Time: 0.041472 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:12] [V] [TRT] Tactic: 8918020581761223752 Time: 0.037828 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:12] [V] [TRT] Tactic: -5905193483742532701 Time: 0.025508 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:12] [V] [TRT] Tactic: -4035591156787122265 Time: 0.027392 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:12] [V] [TRT] Tactic: -2809379259463049391 Time: 0.03616 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:12] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033792 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:12] [V] [TRT] Tactic: -504296718212024303 Time: 0.038272 [05/21/2021-05:48:12] [V] [TRT] Fastest Tactic: 2860655430572478466 Time: 0.024184 [05/21/2021-05:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2860655430572478466 [05/21/2021-05:48:12] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:12] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:12] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:12] [V] [TRT] Tactic: 1373022415249282411 Time: 0.029228 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:12] [V] [TRT] Tactic: 1663866669559596164 Time: 0.04106 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:12] [V] [TRT] Tactic: 2860655430572478466 Time: 0.027208 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02898 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025756 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:12] [V] [TRT] Tactic: 4696204239951173149 Time: 0.023424 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:12] [V] [TRT] Tactic: 5778138195697110003 Time: 0.041936 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:48:12] [V] [TRT] Tactic: 7342025736444949634 Time: 0.029224 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:12] [V] [TRT] Tactic: 8918020581761223752 Time: 0.037492 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:12] [V] [TRT] Tactic: -5905193483742532701 Time: 0.025472 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:48:12] [V] [TRT] Tactic: -5457304872213719461 Time: 0.029656 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:12] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0283 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:12] [V] [TRT] Tactic: -2809379259463049391 Time: 0.036128 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:12] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033792 [05/21/2021-05:48:12] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:13] [V] [TRT] Tactic: -504296718212024303 Time: 0.03392 [05/21/2021-05:48:13] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.023424 [05/21/2021-05:48:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149 [05/21/2021-05:48:13] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1), Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:13] [V] [TRT] Tactic: 0 Time: 0.032512 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1 Time: 0.030224 [05/21/2021-05:48:13] [V] [TRT] Tactic: 2 Time: 0.124744 [05/21/2021-05:48:13] [V] [TRT] Tactic: 56 Time: 0.030592 [05/21/2021-05:48:13] [V] [TRT] Tactic: 58 Time: 0.122624 [05/21/2021-05:48:13] [V] [TRT] Fastest Tactic: 1 Time: 0.030224 [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:48:13] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (FusedConvActConvolution) [05/21/2021-05:48:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:13] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:13] [V] [TRT] Tactic: 2195670545862694453 Time: 0.021556 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:13] [V] [TRT] Tactic: 3891805945559659536 Time: 0.025472 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:13] [V] [TRT] Tactic: 4418200634486186714 Time: 0.016384 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:13] [V] [TRT] Tactic: 5548126322150286555 Time: 0.017664 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:13] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017408 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:13] [V] [TRT] Tactic: 7392644644614664811 Time: 0.018432 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:13] [V] [TRT] Tactic: -4884039206922900293 Time: 0.025392 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:13] [V] [TRT] Tactic: -4374269919094467161 Time: 0.020308 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:13] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0256 [05/21/2021-05:48:13] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.016384 [05/21/2021-05:48:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:48:13] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:13] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudaDepthwiseConvolution) [05/21/2021-05:48:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:13] [V] [TRT] Tactic: 0 Time: 0.046348 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1 Time: 0.043676 [05/21/2021-05:48:13] [V] [TRT] Tactic: 2 Time: 0.110208 [05/21/2021-05:48:13] [V] [TRT] Tactic: 56 Time: 0.046384 [05/21/2021-05:48:13] [V] [TRT] Tactic: 58 Time: 0.110052 [05/21/2021-05:48:13] [V] [TRT] Fastest Tactic: 1 Time: 0.043676 [05/21/2021-05:48:13] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:13] [V] [TRT] Tactic: 254850674756030979 Time: 0.018112 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1011057357468998345 Time: 0.01162 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1156328698016730421 Time: 0.012288 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1362727228442059924 Time: 0.013184 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1576319725282257846 Time: 0.010356 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1832046141070096030 Time: 0.010536 [05/21/2021-05:48:13] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:13] [V] [TRT] Tactic: 1838082074606840426 Time: 0.01216 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:14] [V] [TRT] Tactic: 1899296423087490472 Time: 0.013428 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2238656696610018305 Time: 0.010324 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2428167804343994714 Time: 0.008576 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2541579301352125276 Time: 0.012956 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2559328254295148085 Time: 0.017152 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2657157263811141609 Time: 0.014336 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:14] [V] [TRT] Tactic: 2968605903460894194 Time: 0.010688 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:14] [V] [TRT] Tactic: 3071479995783211391 Time: 0.014708 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:14] [V] [TRT] Tactic: 3359475309458902373 Time: 0.01104 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:14] [V] [TRT] Tactic: 3362537467505018070 Time: 0.013036 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:14] [V] [TRT] Tactic: 3513075359009385578 Time: 0.018532 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:14] [V] [TRT] Tactic: 3704534001553878387 Time: 0.01216 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:14] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009216 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:14] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008244 [05/21/2021-05:48:14] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:15] [V] [TRT] Tactic: 4571819373777460444 Time: 0.018356 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:15] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01378 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:15] [V] [TRT] Tactic: 5059676457552313631 Time: 0.017964 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:15] [V] [TRT] Tactic: 5205510332404400949 Time: 0.012412 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:15] [V] [TRT] Tactic: 5346855796032465921 Time: 0.01346 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:48:15] [V] [TRT] Tactic: 5368829646735632944 Time: 0.011344 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:15] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012704 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00832 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6154447660803990543 Time: 0.008936 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6325769668000961702 Time: 0.011796 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6350273239113254096 Time: 0.014592 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6377497238381488891 Time: 0.013056 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011168 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6859477213531075460 Time: 0.012544 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:48:15] [V] [TRT] Tactic: 6979044990896381511 Time: 0.01728 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:15] [V] [TRT] Tactic: 7216571380637776659 Time: 0.01408 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:15] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010032 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:48:15] [V] [TRT] Tactic: 8072087735545283117 Time: 0.01706 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:15] [V] [TRT] Tactic: 8101703987960976805 Time: 0.013648 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:15] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01024 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:15] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012288 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:15] [V] [TRT] Tactic: 8839784824303350101 Time: 0.013568 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:15] [V] [TRT] Tactic: -9009272790678027912 Time: 0.014216 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8985224497679592364 Time: 0.010292 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8759929675070720385 Time: 0.012764 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8604374562669615024 Time: 0.012808 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8280443484414412687 Time: 0.017768 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8205952393017864204 Time: 0.017176 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:15] [V] [TRT] Tactic: -8131857373260504832 Time: 0.010304 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:15] [V] [TRT] Tactic: -7410012245391920273 Time: 0.013388 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:15] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008628 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:15] [V] [TRT] Tactic: -7089118800560870395 Time: 0.011424 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:48:15] [V] [TRT] Tactic: -6799856376604253964 Time: 0.016364 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:48:15] [V] [TRT] Tactic: -6525498856028268801 Time: 0.010872 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:15] [V] [TRT] Tactic: -6356316196810535311 Time: 0.013312 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:48:15] [V] [TRT] Tactic: -6324345858751792783 Time: 0.011152 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:15] [V] [TRT] Tactic: -6063766379489217211 Time: 0.010752 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:48:15] [V] [TRT] Tactic: -5777580938094193096 Time: 0.008956 [05/21/2021-05:48:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:48:16] [V] [TRT] Tactic: -5657273398217409378 Time: 0.017124 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:16] [V] [TRT] Tactic: -5530886555766748586 Time: 0.012416 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:16] [V] [TRT] Tactic: -5409588854490562130 Time: 0.010136 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:16] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009916 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:16] [V] [TRT] Tactic: -5127240325355316006 Time: 0.009232 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01154 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4825567853927730435 Time: 0.00822 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4796511246675321840 Time: 0.010228 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4548822885169694805 Time: 0.012528 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010144 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0118 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4152066959007262150 Time: 0.01822 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:16] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009968 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3987638434926559037 Time: 0.010544 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3905653247016903130 Time: 0.013484 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3903974568488493144 Time: 0.0096 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012732 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3864869056275745423 Time: 0.012672 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011704 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3338665856053412950 Time: 0.011264 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:16] [V] [TRT] Tactic: -3058330359340425555 Time: 0.010496 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2878731503146438856 Time: 0.012716 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2662892962457732243 Time: 0.009312 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2602982885923184927 Time: 0.012572 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2530740716768816092 Time: 0.0122 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2353603993968373338 Time: 0.013468 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2332828394978346992 Time: 0.011332 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2161909437867201546 Time: 0.013296 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2032577876140256150 Time: 0.010224 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:48:16] [V] [TRT] Tactic: -2003055242756584050 Time: 0.009744 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01408 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1640527254204634147 Time: 0.010236 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1562548049711204899 Time: 0.012352 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009512 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1099247066487349374 Time: 0.012544 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:48:16] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0103 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:48:16] [V] [TRT] Tactic: -910286698936744682 Time: 0.011988 [05/21/2021-05:48:16] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:48:17] [V] [TRT] Tactic: -606726295133751039 Time: 0.009216 [05/21/2021-05:48:17] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:48:17] [V] [TRT] Tactic: -406984317033388136 Time: 0.011636 [05/21/2021-05:48:17] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:48:17] [V] [TRT] Tactic: -331499326992534460 Time: 0.009216 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: -4825567853927730435 Time: 0.00822 [05/21/2021-05:48:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4825567853927730435 [05/21/2021-05:48:17] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution) [05/21/2021-05:48:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution) [05/21/2021-05:48:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.012032 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.010368 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.010368 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.011776 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.010216 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.010216 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.011008 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.009728 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008264 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005848 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005848 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.0084 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009648 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0084 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.01276 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009904 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009904 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.013024 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008808 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009336 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.008808 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.009224 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009212 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009212 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.006704 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.006704 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.0066 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0066 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.013324 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009984 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009984 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.013184 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.007464 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.007464 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008912 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009448 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.008912 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.009124 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009268 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.009124 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.007672 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.007552 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.007576 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.007596 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.007576 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.011172 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.007076 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.007076 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008736 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009216 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.008736 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009232 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.011392 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.009752 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005556 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005556 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.009728 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.009848 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.009728 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.011552 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008872 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.00798 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00798 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008996 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.008196 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.008196 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.014768 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008752 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.008496 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00768 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.01058 [05/21/2021-05:48:17] [V] [TRT] Tactic: 0 Time: 0.00542 [05/21/2021-05:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00542 [05/21/2021-05:48:17] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:17] [V] [TRT] Tactic: 1002 Time: 0.007592 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007256 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007256 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007156 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007156 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.011264 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.00822 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.004712 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004712 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(25088,1:16,896,32) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.008064 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007512 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007512 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,784,28,1) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.010668 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.00936 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00936 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,1,14336,512) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.007728 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(100352,1:4,3584,128) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.007808 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007808 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007808 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(401408,784,28,1) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.012348 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.009384 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009384 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(200704,784:2,28,1) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.009344 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.009788 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.009344 [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(50176,1:8,1792,64) (Reformat) [05/21/2021-05:48:18] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.007744 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.00768 [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.005972 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005972 [05/21/2021-05:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.005724 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005724 [05/21/2021-05:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Tactic: 0 Time: 0.0064 [05/21/2021-05:48:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0064 [05/21/2021-05:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale) [05/21/2021-05:48:18] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:18] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:48:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:18] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:48:18] [V] [TRT] Tactic: 589823 Time: 0.109696 [05/21/2021-05:48:18] [V] [TRT] Tactic: 655359 Time: 0.071572 [05/21/2021-05:48:18] [V] [TRT] Tactic: 786431 Time: 0.029896 [05/21/2021-05:48:18] [V] [TRT] Tactic: 851967 Time: 0.026308 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1179647 Time: 0.020652 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1310719 Time: 0.0509 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1376255 Time: 0.0761 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1441791 Time: 0.019456 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1507327 Time: 0.042496 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1638399 Time: 0.02166 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1835007 Time: 0.03422 [05/21/2021-05:48:18] [V] [TRT] Tactic: 1900543 Time: 0.076424 [05/21/2021-05:48:18] [V] [TRT] Tactic: 2097151 Time: 0.018008 [05/21/2021-05:48:18] [V] [TRT] Tactic: 2162687 Time: 0.077696 [05/21/2021-05:48:18] [V] [TRT] Tactic: 2293759 Time: 0.072088 [05/21/2021-05:48:18] [V] [TRT] Tactic: 2359295 Time: 0.044696 [05/21/2021-05:48:18] [V] [TRT] Tactic: 2686975 Time: 0.073088 [05/21/2021-05:48:18] [V] [TRT] Tactic: 3080191 Time: 0.037624 [05/21/2021-05:48:18] [V] [TRT] Tactic: 3342335 Time: 0.042752 [05/21/2021-05:48:18] [V] [TRT] Tactic: 3407871 Time: 0.041064 [05/21/2021-05:48:18] [V] [TRT] Tactic: 3538943 Time: 0.02666 [05/21/2021-05:48:19] [V] [TRT] Tactic: 3670015 Time: 0.1388 [05/21/2021-05:48:19] [V] [TRT] Tactic: 3932159 Time: 0.063808 [05/21/2021-05:48:19] [V] [TRT] Tactic: 3997695 Time: 0.021504 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4063231 Time: 0.0256 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4194303 Time: 0.031616 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4259839 Time: 0.0194 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4325375 Time: 0.025132 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4521983 Time: 0.070284 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4587519 Time: 0.022752 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4653055 Time: 0.0192 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4915199 Time: 0.021504 [05/21/2021-05:48:19] [V] [TRT] Tactic: 4980735 Time: 0.038912 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5177343 Time: 0.020536 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5242879 Time: 0.036736 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5373951 Time: 0.022912 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5439487 Time: 0.032768 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5570559 Time: 0.041856 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5636095 Time: 0.0261 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5701631 Time: 0.069792 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5767167 Time: 0.05354 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5832703 Time: 0.040192 [05/21/2021-05:48:19] [V] [TRT] Tactic: 5898239 Time: 0.018972 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6029311 Time: 0.068992 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6225919 Time: 0.026328 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6291455 Time: 0.020608 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6422527 Time: 0.037964 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6750207 Time: 0.0243 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6815743 Time: 0.04158 [05/21/2021-05:48:19] [V] [TRT] Tactic: 6946815 Time: 0.032036 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7012351 Time: 0.018068 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7077887 Time: 0.027384 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7143423 Time: 0.04096 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7208959 Time: 0.039936 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7340031 Time: 0.019492 [05/21/2021-05:48:19] [V] [TRT] Tactic: 7405567 Time: 0.022508 [05/21/2021-05:48:20] [V] [TRT] Tactic: 7536639 Time: 0.065152 [05/21/2021-05:48:20] [V] [TRT] Tactic: 7602175 Time: 0.029828 [05/21/2021-05:48:20] [V] [TRT] Tactic: 7733247 Time: 0.027264 [05/21/2021-05:48:20] [V] [TRT] Tactic: 7798783 Time: 0.029184 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8191999 Time: 0.028876 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8257535 Time: 0.02076 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8323071 Time: 0.030376 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8650751 Time: 0.029656 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8716287 Time: 0.027376 [05/21/2021-05:48:20] [V] [TRT] Tactic: 9109503 Time: 0.017684 [05/21/2021-05:48:20] [V] [TRT] Tactic: 9568255 Time: 0.021564 [05/21/2021-05:48:20] [V] [TRT] Tactic: 9895935 Time: 0.031232 [05/21/2021-05:48:20] [V] [TRT] Tactic: 10223615 Time: 0.072524 [05/21/2021-05:48:20] [V] [TRT] Tactic: 10354687 Time: 0.022832 [05/21/2021-05:48:20] [V] [TRT] Tactic: 10551295 Time: 0.04408 [05/21/2021-05:48:20] [V] [TRT] Tactic: 10747903 Time: 0.025856 [05/21/2021-05:48:20] [V] [TRT] Tactic: 10944511 Time: 0.03896 [05/21/2021-05:48:20] [V] [TRT] Fastest Tactic: 9109503 Time: 0.017684 [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:20] [V] [TRT] Tactic: 0 Time: 0.029732 [05/21/2021-05:48:20] [V] [TRT] Tactic: 1 Time: 0.03072 [05/21/2021-05:48:20] [V] [TRT] Tactic: 2 Time: 0.091144 [05/21/2021-05:48:20] [V] [TRT] Tactic: 4 Time: 0.744256 [05/21/2021-05:48:20] [V] [TRT] Tactic: 5 Time: 0.096028 [05/21/2021-05:48:20] [V] [TRT] Tactic: 56 Time: 0.033324 [05/21/2021-05:48:20] [V] [TRT] Tactic: 57 Time: 0.033408 [05/21/2021-05:48:20] [V] [TRT] Tactic: 58 Time: 0.11648 [05/21/2021-05:48:20] [V] [TRT] Tactic: 60 Time: 0.7434 [05/21/2021-05:48:20] [V] [TRT] Tactic: 61 Time: 0.096104 [05/21/2021-05:48:20] [V] [TRT] Tactic: 112 Time: 0.032276 [05/21/2021-05:48:20] [V] [TRT] Tactic: 113 Time: 0.030336 [05/21/2021-05:48:20] [V] [TRT] Tactic: 114 Time: 0.113364 [05/21/2021-05:48:20] [V] [TRT] Tactic: 116 Time: 0.743272 [05/21/2021-05:48:20] [V] [TRT] Tactic: 117 Time: 0.096316 [05/21/2021-05:48:20] [V] [TRT] Fastest Tactic: 0 Time: 0.029732 [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:20] [V] [TRT] Tactic: 4549827808004681195 Time: 0.049664 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:20] [V] [TRT] Tactic: 5779835512569528575 Time: 0.061896 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:20] [V] [TRT] Tactic: 9151672657204310840 Time: 0.060176 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:20] [V] [TRT] Tactic: -7491730084094677098 Time: 0.060572 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:48:20] [V] [TRT] Tactic: -6622064180404051845 Time: 0.056332 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:20] [V] [TRT] Tactic: -6313876406580483184 Time: 0.06144 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:20] [V] [TRT] Tactic: -6273689210331812572 Time: 0.061056 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:20] [V] [TRT] Tactic: -4337126844824617177 Time: 0.045312 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:20] [V] [TRT] Tactic: -1123676555321336786 Time: 0.061056 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:20] [V] [TRT] Tactic: -701551393537224327 Time: 0.052176 [05/21/2021-05:48:20] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.045312 [05/21/2021-05:48:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [05/21/2021-05:48:20] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:20] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:20] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06422 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:20] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038572 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:20] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02364 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:20] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023424 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:20] [V] [TRT] Tactic: 4696204239951173149 Time: 0.037812 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:20] [V] [TRT] Tactic: 5778138195697110003 Time: 0.064976 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:20] [V] [TRT] Tactic: 8918020581761223752 Time: 0.05882 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:20] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:20] [V] [TRT] Tactic: -4035591156787122265 Time: 0.022576 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:20] [V] [TRT] Tactic: -2809379259463049391 Time: 0.064 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:20] [V] [TRT] Tactic: -1985235291706575900 Time: 0.05836 [05/21/2021-05:48:20] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:21] [V] [TRT] Tactic: -504296718212024303 Time: 0.062008 [05/21/2021-05:48:21] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.022576 [05/21/2021-05:48:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:48:21] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:21] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1373022415249282411 Time: 0.045348 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1663866669559596164 Time: 0.064372 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038472 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:21] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023712 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:21] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023424 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:21] [V] [TRT] Tactic: 4696204239951173149 Time: 0.03798 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:21] [V] [TRT] Tactic: 5778138195697110003 Time: 0.064896 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:21] [V] [TRT] Tactic: 8918020581761223752 Time: 0.058368 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:48:21] [V] [TRT] Tactic: -7067026478815706014 Time: 0.042156 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:21] [V] [TRT] Tactic: -5905193483742532701 Time: 0.033796 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:21] [V] [TRT] Tactic: -4035591156787122265 Time: 0.022528 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:21] [V] [TRT] Tactic: -2809379259463049391 Time: 0.067552 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:21] [V] [TRT] Tactic: -1985235291706575900 Time: 0.059392 [05/21/2021-05:48:21] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:21] [V] [TRT] Tactic: -504296718212024303 Time: 0.05954 [05/21/2021-05:48:21] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.022528 [05/21/2021-05:48:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:48:21] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:21] [V] [TRT] Tactic: 0 Time: 0.033148 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1 Time: 0.033408 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2 Time: 0.11844 [05/21/2021-05:48:21] [V] [TRT] Tactic: 4 Time: 0.740916 [05/21/2021-05:48:21] [V] [TRT] Tactic: 5 Time: 0.09668 [05/21/2021-05:48:21] [V] [TRT] Tactic: 56 Time: 0.033152 [05/21/2021-05:48:21] [V] [TRT] Tactic: 58 Time: 0.118524 [05/21/2021-05:48:21] [V] [TRT] Tactic: 60 Time: 0.741336 [05/21/2021-05:48:21] [V] [TRT] Tactic: 61 Time: 0.0958 [05/21/2021-05:48:21] [V] [TRT] Fastest Tactic: 0 Time: 0.033148 [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:48:21] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:21] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:21] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:48:21] [V] [TRT] Tactic: 589823 Time: 0.058752 [05/21/2021-05:48:21] [V] [TRT] Tactic: 655359 Time: 0.042104 [05/21/2021-05:48:21] [V] [TRT] Tactic: 786431 Time: 0.018468 [05/21/2021-05:48:21] [V] [TRT] Tactic: 851967 Time: 0.01682 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1179647 Time: 0.013596 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1310719 Time: 0.031988 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1376255 Time: 0.044728 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1441791 Time: 0.013328 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1507327 Time: 0.026112 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1638399 Time: 0.014328 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1835007 Time: 0.01876 [05/21/2021-05:48:21] [V] [TRT] Tactic: 1900543 Time: 0.045816 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2097151 Time: 0.012416 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2162687 Time: 0.046252 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2293759 Time: 0.041288 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2359295 Time: 0.026464 [05/21/2021-05:48:21] [V] [TRT] Tactic: 2686975 Time: 0.041104 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3080191 Time: 0.023156 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3342335 Time: 0.026008 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3407871 Time: 0.023544 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3538943 Time: 0.01572 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3670015 Time: 0.079988 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3932159 Time: 0.03584 [05/21/2021-05:48:21] [V] [TRT] Tactic: 3997695 Time: 0.014664 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4063231 Time: 0.017736 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4194303 Time: 0.018176 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4259839 Time: 0.012844 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4325375 Time: 0.01472 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4521983 Time: 0.04142 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4587519 Time: 0.013468 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4653055 Time: 0.013184 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4915199 Time: 0.013348 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4980735 Time: 0.022604 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5177343 Time: 0.01348 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5242879 Time: 0.022404 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5373951 Time: 0.014368 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5439487 Time: 0.019748 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5570559 Time: 0.025508 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5636095 Time: 0.017024 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5701631 Time: 0.039152 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5767167 Time: 0.029592 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5832703 Time: 0.023584 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5898239 Time: 0.013312 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6029311 Time: 0.037888 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6225919 Time: 0.014848 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6291455 Time: 0.013312 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6422527 Time: 0.022656 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6750207 Time: 0.015744 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6815743 Time: 0.024492 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6946815 Time: 0.020016 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7012351 Time: 0.012292 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7077887 Time: 0.015356 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7143423 Time: 0.02496 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7208959 Time: 0.024536 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7340031 Time: 0.01344 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7405567 Time: 0.014508 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7536639 Time: 0.035816 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7602175 Time: 0.018048 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7733247 Time: 0.016552 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7798783 Time: 0.018576 [05/21/2021-05:48:22] [V] [TRT] Tactic: 8191999 Time: 0.017704 [05/21/2021-05:48:22] [V] [TRT] Tactic: 8257535 Time: 0.013112 [05/21/2021-05:48:22] [V] [TRT] Tactic: 8323071 Time: 0.018588 [05/21/2021-05:48:22] [V] [TRT] Tactic: 8650751 Time: 0.018432 [05/21/2021-05:48:22] [V] [TRT] Tactic: 8716287 Time: 0.016476 [05/21/2021-05:48:22] [V] [TRT] Tactic: 9109503 Time: 0.01226 [05/21/2021-05:48:22] [V] [TRT] Tactic: 9568255 Time: 0.013312 [05/21/2021-05:48:22] [V] [TRT] Tactic: 9895935 Time: 0.017536 [05/21/2021-05:48:22] [V] [TRT] Tactic: 10223615 Time: 0.040988 [05/21/2021-05:48:22] [V] [TRT] Tactic: 10354687 Time: 0.013312 [05/21/2021-05:48:22] [V] [TRT] Tactic: 10551295 Time: 0.025872 [05/21/2021-05:48:22] [V] [TRT] Tactic: 10747903 Time: 0.017272 [05/21/2021-05:48:22] [V] [TRT] Tactic: 10944511 Time: 0.022548 [05/21/2021-05:48:22] [V] [TRT] Fastest Tactic: 9109503 Time: 0.01226 [05/21/2021-05:48:22] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:22] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:22] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:22] [V] [TRT] Tactic: 2195670545862694453 Time: 0.029724 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:22] [V] [TRT] Tactic: 3891805945559659536 Time: 0.041332 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:22] [V] [TRT] Tactic: 4418200634486186714 Time: 0.026044 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:22] [V] [TRT] Tactic: 5548126322150286555 Time: 0.028728 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:22] [V] [TRT] Tactic: 6057304366605292508 Time: 0.027716 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:22] [V] [TRT] Tactic: 7392644644614664811 Time: 0.025716 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:22] [V] [TRT] Tactic: -4884039206922900293 Time: 0.04096 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:22] [V] [TRT] Tactic: -4374269919094467161 Time: 0.026772 [05/21/2021-05:48:22] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:22] [V] [TRT] Tactic: -1546027692247304867 Time: 0.04268 [05/21/2021-05:48:22] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.025716 [05/21/2021-05:48:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [05/21/2021-05:48:22] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:22] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:23] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:48:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:23] [V] [TRT] Tactic: 0 Time: 0.045312 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1 Time: 0.045332 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2 Time: 0.107012 [05/21/2021-05:48:23] [V] [TRT] Tactic: 56 Time: 0.04536 [05/21/2021-05:48:23] [V] [TRT] Tactic: 58 Time: 0.107412 [05/21/2021-05:48:23] [V] [TRT] Fastest Tactic: 0 Time: 0.045312 [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:23] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:23] [V] [TRT] Tactic: 254850674756030979 Time: 0.025472 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1156328698016730421 Time: 0.016656 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017384 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011252 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1832046141070096030 Time: 0.010988 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1838082074606840426 Time: 0.010852 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:23] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008824 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2238656696610018305 Time: 0.01098 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2541579301352125276 Time: 0.015648 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2559328254295148085 Time: 0.024576 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00908 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:23] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011228 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3071479995783211391 Time: 0.007508 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010368 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01536 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0256 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016816 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:48:23] [V] [TRT] Tactic: 3899310434460415852 Time: 0.008064 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:23] [V] [TRT] Tactic: 4278315135102886928 Time: 0.010656 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:48:23] [V] [TRT] Tactic: 4370476717970497892 Time: 0.011232 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:23] [V] [TRT] Tactic: 4480294673430783793 Time: 0.010496 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:48:23] [V] [TRT] Tactic: 4491683531415781597 Time: 0.024704 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:48:23] [V] [TRT] Tactic: 4528997467275241200 Time: 0.015568 [05/21/2021-05:48:23] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:24] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025068 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:48:24] [V] [TRT] Tactic: 4595173549602041350 Time: 0.024544 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:24] [V] [TRT] Tactic: 4802447371470387646 Time: 0.017536 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:48:24] [V] [TRT] Tactic: 4993757826442493905 Time: 0.009432 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:24] [V] [TRT] Tactic: 5059676457552313631 Time: 0.024576 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:24] [V] [TRT] Tactic: 5205510332404400949 Time: 0.016256 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:24] [V] [TRT] Tactic: 5346855796032465921 Time: 0.016488 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:24] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016476 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:24] [V] [TRT] Tactic: 6034364043891107501 Time: 0.010296 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:24] [V] [TRT] Tactic: 6377497238381488891 Time: 0.015652 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:24] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011656 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:48:24] [V] [TRT] Tactic: 6697277555581639516 Time: 0.009344 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:24] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00818 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:24] [V] [TRT] Tactic: 7216571380637776659 Time: 0.018432 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:24] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010784 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:24] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009284 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:24] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011392 [05/21/2021-05:48:24] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:25] [V] [TRT] Tactic: 8764780417487154889 Time: 0.016356 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:48:25] [V] [TRT] Tactic: 8823554289762712606 Time: 0.01072 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:25] [V] [TRT] Tactic: 8839784824303350101 Time: 0.017772 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:48:25] [V] [TRT] Tactic: -9203179519031456182 Time: 0.008192 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:25] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018584 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:25] [V] [TRT] Tactic: -8604374562669615024 Time: 0.008716 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:25] [V] [TRT] Tactic: -8280443484414412687 Time: 0.024576 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:25] [V] [TRT] Tactic: -8205952393017864204 Time: 0.023804 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:25] [V] [TRT] Tactic: -8131857373260504832 Time: 0.010352 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:25] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00882 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:25] [V] [TRT] Tactic: -7099920365135295801 Time: 0.009312 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:25] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0086 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:48:25] [V] [TRT] Tactic: -6768327495007644783 Time: 0.015616 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:25] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009428 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:25] [V] [TRT] Tactic: -6063766379489217211 Time: 0.01126 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:25] [V] [TRT] Tactic: -5530886555766748586 Time: 0.015576 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:25] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00832 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:25] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011164 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:25] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010356 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008124 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011392 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008356 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010264 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00818 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4152066959007262150 Time: 0.025728 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:25] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011532 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3905653247016903130 Time: 0.016768 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3903342530518878192 Time: 0.016896 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01734 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008408 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:25] [V] [TRT] Tactic: -3058330359340425555 Time: 0.010952 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:48:25] [V] [TRT] Tactic: -2878731503146438856 Time: 0.014456 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:48:25] [V] [TRT] Tactic: -2602982885923184927 Time: 0.01536 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:48:25] [V] [TRT] Tactic: -2353603993968373338 Time: 0.017948 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:48:25] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011332 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:48:25] [V] [TRT] Tactic: -2003055242756584050 Time: 0.01024 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:25] [V] [TRT] Tactic: -1985778916402815946 Time: 0.017832 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:48:25] [V] [TRT] Tactic: -1828674067637788567 Time: 0.007396 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:48:25] [V] [TRT] Tactic: -1640527254204634147 Time: 0.010852 [05/21/2021-05:48:25] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:48:25] [V] [TRT] Tactic: -1562548049711204899 Time: 0.015748 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:48:26] [V] [TRT] Tactic: -1242202084391243207 Time: 0.010624 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:26] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00836 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:48:26] [V] [TRT] Tactic: -1038291877007553549 Time: 0.010312 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:48:26] [V] [TRT] Tactic: -406984317033388136 Time: 0.015396 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:48:26] [V] [TRT] Tactic: -331499326992534460 Time: 0.010228 [05/21/2021-05:48:26] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:48:26] [V] [TRT] Tactic: -206523504474952360 Time: 0.016388 [05/21/2021-05:48:26] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.007396 [05/21/2021-05:48:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567 [05/21/2021-05:48:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution) [05/21/2021-05:48:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution) [05/21/2021-05:48:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution) [05/21/2021-05:48:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:26] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:48:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:48:26] [V] [TRT] Tactic: 524287 Time: 0.053728 [05/21/2021-05:48:26] [V] [TRT] Tactic: 720895 Time: 0.046404 [05/21/2021-05:48:26] [V] [TRT] Tactic: 983039 Time: 0.0269 [05/21/2021-05:48:26] [V] [TRT] Tactic: 1048575 Time: 0.039928 [05/21/2021-05:48:26] [V] [TRT] Tactic: 1703935 Time: 0.02984 [05/21/2021-05:48:26] [V] [TRT] Tactic: 1769471 Time: 0.026312 [05/21/2021-05:48:26] [V] [TRT] Tactic: 1966079 Time: 0.09216 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2031615 Time: 0.073808 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2228223 Time: 0.040992 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2424831 Time: 0.021504 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2621439 Time: 0.027776 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2752511 Time: 0.049152 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2818047 Time: 0.047108 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2883583 Time: 0.102432 [05/21/2021-05:48:26] [V] [TRT] Tactic: 3014655 Time: 0.02624 [05/21/2021-05:48:26] [V] [TRT] Tactic: 3145727 Time: 0.029444 [05/21/2021-05:48:26] [V] [TRT] Tactic: 3473407 Time: 0.058804 [05/21/2021-05:48:26] [V] [TRT] Tactic: 3604479 Time: 0.027136 [05/21/2021-05:48:26] [V] [TRT] Tactic: 3735551 Time: 0.04736 [05/21/2021-05:48:26] [V] [TRT] Tactic: 4390911 Time: 0.09434 [05/21/2021-05:48:26] [V] [TRT] Tactic: 5046271 Time: 0.03448 [05/21/2021-05:48:26] [V] [TRT] Tactic: 5963775 Time: 0.079808 [05/21/2021-05:48:26] [V] [TRT] Tactic: 6160383 Time: 0.048716 [05/21/2021-05:48:26] [V] [TRT] Tactic: 6488063 Time: 0.042668 [05/21/2021-05:48:26] [V] [TRT] Tactic: 6881279 Time: 0.066224 [05/21/2021-05:48:26] [V] [TRT] Tactic: 7274495 Time: 0.021884 [05/21/2021-05:48:26] [V] [TRT] Tactic: 7864319 Time: 0.021276 [05/21/2021-05:48:26] [V] [TRT] Tactic: 7995391 Time: 0.050708 [05/21/2021-05:48:26] [V] [TRT] Tactic: 8585215 Time: 0.061184 [05/21/2021-05:48:26] [V] [TRT] Tactic: 8847359 Time: 0.02186 [05/21/2021-05:48:26] [V] [TRT] Tactic: 8978431 Time: 0.081428 [05/21/2021-05:48:26] [V] [TRT] Tactic: 9043967 Time: 0.025608 [05/21/2021-05:48:26] [V] [TRT] Tactic: 9175039 Time: 0.026624 [05/21/2021-05:48:26] [V] [TRT] Tactic: 9502719 Time: 0.090112 [05/21/2021-05:48:26] [V] [TRT] Tactic: 9830399 Time: 0.047104 [05/21/2021-05:48:26] [V] [TRT] Tactic: 9961471 Time: 0.023552 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10027007 Time: 0.035968 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10092543 Time: 0.09348 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10289151 Time: 0.0928 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10485759 Time: 0.027516 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10682367 Time: 0.027072 [05/21/2021-05:48:26] [V] [TRT] Tactic: 10813439 Time: 0.030464 [05/21/2021-05:48:26] [V] [TRT] Fastest Tactic: 7864319 Time: 0.021276 [05/21/2021-05:48:26] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:26] [V] [TRT] Tactic: 0 Time: 0.055032 [05/21/2021-05:48:26] [V] [TRT] Tactic: 1 Time: 0.052692 [05/21/2021-05:48:26] [V] [TRT] Tactic: 2 Time: 0.103424 [05/21/2021-05:48:26] [V] [TRT] Tactic: 4 Time: 0.214728 [05/21/2021-05:48:26] [V] [TRT] Tactic: 5 Time: 0.211296 [05/21/2021-05:48:26] [V] [TRT] Tactic: 6 Time: 0.03122 [05/21/2021-05:48:26] [V] [TRT] Tactic: 56 Time: 0.05274 [05/21/2021-05:48:27] [V] [TRT] Tactic: 57 Time: 0.05282 [05/21/2021-05:48:27] [V] [TRT] Tactic: 58 Time: 0.103488 [05/21/2021-05:48:27] [V] [TRT] Tactic: 60 Time: 0.214924 [05/21/2021-05:48:27] [V] [TRT] Tactic: 61 Time: 0.21142 [05/21/2021-05:48:27] [V] [TRT] Tactic: 62 Time: 0.031192 [05/21/2021-05:48:27] [V] [TRT] Tactic: 112 Time: 0.054052 [05/21/2021-05:48:27] [V] [TRT] Tactic: 113 Time: 0.051908 [05/21/2021-05:48:27] [V] [TRT] Tactic: 114 Time: 0.07624 [05/21/2021-05:48:27] [V] [TRT] Tactic: 116 Time: 0.212736 [05/21/2021-05:48:27] [V] [TRT] Tactic: 117 Time: 0.209664 [05/21/2021-05:48:27] [V] [TRT] Tactic: 118 Time: 0.030732 [05/21/2021-05:48:27] [V] [TRT] Fastest Tactic: 118 Time: 0.030732 [05/21/2021-05:48:27] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4549827808004681195 Time: 0.103296 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:27] [V] [TRT] Tactic: 5779835512569528575 Time: 0.129796 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:48:27] [V] [TRT] Tactic: 6053873026024413720 Time: 0.13456 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:48:27] [V] [TRT] Tactic: 6767548733843469815 Time: 0.10564 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:27] [V] [TRT] Tactic: -6313876406580483184 Time: 0.126848 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:27] [V] [TRT] Tactic: -1123676555321336786 Time: 0.133248 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:27] [V] [TRT] Tactic: -701551393537224327 Time: 0.114944 [05/21/2021-05:48:27] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.103296 [05/21/2021-05:48:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319 [05/21/2021-05:48:27] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:27] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:27] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:27] [V] [TRT] Tactic: 2860655430572478466 Time: 0.077056 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4474630279712975759 Time: 0.04402 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4479823862704990365 Time: 0.04302 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4696204239951173149 Time: 0.077212 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:27] [V] [TRT] Tactic: 5778138195697110003 Time: 0.134624 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:48:27] [V] [TRT] Tactic: 7155825427510256858 Time: 0.128256 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:27] [V] [TRT] Tactic: 8918020581761223752 Time: 0.124944 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:48:27] [V] [TRT] Tactic: -4756382386362004279 Time: 0.07612 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:48:27] [V] [TRT] Tactic: -3855385237722507464 Time: 0.133632 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:27] [V] [TRT] Tactic: -2809379259463049391 Time: 0.13116 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:27] [V] [TRT] Tactic: -504296718212024303 Time: 0.12416 [05/21/2021-05:48:27] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.04302 [05/21/2021-05:48:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:27] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:27] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:27] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:27] [V] [TRT] Tactic: 2860655430572478466 Time: 0.076928 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4474630279712975759 Time: 0.044296 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043008 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:27] [V] [TRT] Tactic: 4696204239951173149 Time: 0.077184 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:27] [V] [TRT] Tactic: 5778138195697110003 Time: 0.134424 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:48:27] [V] [TRT] Tactic: 7155825427510256858 Time: 0.127116 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:48:27] [V] [TRT] Tactic: 7342025736444949634 Time: 0.089984 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:27] [V] [TRT] Tactic: 8918020581761223752 Time: 0.124104 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:48:27] [V] [TRT] Tactic: -7377458734869418330 Time: 0.088064 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:48:27] [V] [TRT] Tactic: -5457304872213719461 Time: 0.089308 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:48:27] [V] [TRT] Tactic: -4756382386362004279 Time: 0.076032 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:48:27] [V] [TRT] Tactic: -3855385237722507464 Time: 0.13312 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:27] [V] [TRT] Tactic: -2809379259463049391 Time: 0.130688 [05/21/2021-05:48:27] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:27] [V] [TRT] Tactic: -504296718212024303 Time: 0.124096 [05/21/2021-05:48:28] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043008 [05/21/2021-05:48:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:28] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:28] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:28] [V] [TRT] Tactic: 0 Time: 0.084224 [05/21/2021-05:48:28] [V] [TRT] Tactic: 1 Time: 0.063232 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2 Time: 0.094624 [05/21/2021-05:48:28] [V] [TRT] Tactic: 4 Time: 0.212908 [05/21/2021-05:48:28] [V] [TRT] Tactic: 5 Time: 0.209588 [05/21/2021-05:48:28] [V] [TRT] Tactic: 6 Time: 0.04928 [05/21/2021-05:48:28] [V] [TRT] Tactic: 56 Time: 0.062336 [05/21/2021-05:48:28] [V] [TRT] Tactic: 58 Time: 0.09394 [05/21/2021-05:48:28] [V] [TRT] Tactic: 60 Time: 0.212824 [05/21/2021-05:48:28] [V] [TRT] Tactic: 61 Time: 0.209524 [05/21/2021-05:48:28] [V] [TRT] Tactic: 62 Time: 0.049152 [05/21/2021-05:48:28] [V] [TRT] Fastest Tactic: 62 Time: 0.049152 [05/21/2021-05:48:28] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62 [05/21/2021-05:48:28] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:28] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:48:28] [V] [TRT] Tactic: 524287 Time: 0.037164 [05/21/2021-05:48:28] [V] [TRT] Tactic: 720895 Time: 0.031264 [05/21/2021-05:48:28] [V] [TRT] Tactic: 983039 Time: 0.018664 [05/21/2021-05:48:28] [V] [TRT] Tactic: 1048575 Time: 0.0256 [05/21/2021-05:48:28] [V] [TRT] Tactic: 1703935 Time: 0.021588 [05/21/2021-05:48:28] [V] [TRT] Tactic: 1769471 Time: 0.01876 [05/21/2021-05:48:28] [V] [TRT] Tactic: 1966079 Time: 0.057908 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2031615 Time: 0.049312 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2228223 Time: 0.026624 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2424831 Time: 0.01536 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2621439 Time: 0.02048 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2752511 Time: 0.033792 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2818047 Time: 0.032884 [05/21/2021-05:48:28] [V] [TRT] Tactic: 2883583 Time: 0.070528 [05/21/2021-05:48:28] [V] [TRT] Tactic: 3014655 Time: 0.0192 [05/21/2021-05:48:28] [V] [TRT] Tactic: 3145727 Time: 0.021068 [05/21/2021-05:48:28] [V] [TRT] Tactic: 3473407 Time: 0.03812 [05/21/2021-05:48:28] [V] [TRT] Tactic: 3604479 Time: 0.01906 [05/21/2021-05:48:28] [V] [TRT] Tactic: 3735551 Time: 0.031624 [05/21/2021-05:48:28] [V] [TRT] Tactic: 4390911 Time: 0.064 [05/21/2021-05:48:28] [V] [TRT] Tactic: 5046271 Time: 0.02164 [05/21/2021-05:48:28] [V] [TRT] Tactic: 5963775 Time: 0.055184 [05/21/2021-05:48:28] [V] [TRT] Tactic: 6160383 Time: 0.034356 [05/21/2021-05:48:28] [V] [TRT] Tactic: 6488063 Time: 0.030976 [05/21/2021-05:48:28] [V] [TRT] Tactic: 6881279 Time: 0.045824 [05/21/2021-05:48:28] [V] [TRT] Tactic: 7274495 Time: 0.015664 [05/21/2021-05:48:28] [V] [TRT] Tactic: 7864319 Time: 0.014988 [05/21/2021-05:48:28] [V] [TRT] Tactic: 7995391 Time: 0.033024 [05/21/2021-05:48:28] [V] [TRT] Tactic: 8585215 Time: 0.041856 [05/21/2021-05:48:28] [V] [TRT] Tactic: 8847359 Time: 0.015348 [05/21/2021-05:48:28] [V] [TRT] Tactic: 8978431 Time: 0.05326 [05/21/2021-05:48:28] [V] [TRT] Tactic: 9043967 Time: 0.017152 [05/21/2021-05:48:28] [V] [TRT] Tactic: 9175039 Time: 0.018432 [05/21/2021-05:48:28] [V] [TRT] Tactic: 9502719 Time: 0.062464 [05/21/2021-05:48:28] [V] [TRT] Tactic: 9830399 Time: 0.031952 [05/21/2021-05:48:28] [V] [TRT] Tactic: 9961471 Time: 0.01618 [05/21/2021-05:48:28] [V] [TRT] Tactic: 10027007 Time: 0.023552 [05/21/2021-05:48:28] [V] [TRT] Tactic: 10092543 Time: 0.064352 [05/21/2021-05:48:28] [V] [TRT] Tactic: 10289151 Time: 0.058392 [05/21/2021-05:48:28] [V] [TRT] Tactic: 10485759 Time: 0.019104 [05/21/2021-05:48:29] [V] [TRT] Tactic: 10682367 Time: 0.020992 [05/21/2021-05:48:29] [V] [TRT] Tactic: 10813439 Time: 0.020616 [05/21/2021-05:48:29] [V] [TRT] Fastest Tactic: 7864319 Time: 0.014988 [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2195670545862694453 Time: 0.066176 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:48:29] [V] [TRT] Tactic: 3419182076704469245 Time: 0.063488 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:29] [V] [TRT] Tactic: 3891805945559659536 Time: 0.087168 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:29] [V] [TRT] Tactic: 5548126322150286555 Time: 0.060416 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:29] [V] [TRT] Tactic: 6057304366605292508 Time: 0.052528 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:48:29] [V] [TRT] Tactic: -7928611605886347652 Time: 0.089848 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:48:29] [V] [TRT] Tactic: -5172391392092686714 Time: 0.071432 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:29] [V] [TRT] Tactic: -4374269919094467161 Time: 0.053652 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953 [05/21/2021-05:48:29] [V] [TRT] Tactic: -4083394051665370953 Time: 0.016372 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:29] [V] [TRT] Tactic: -1546027692247304867 Time: 0.085668 [05/21/2021-05:48:29] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.016372 [05/21/2021-05:48:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319 [05/21/2021-05:48:29] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:29] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:48:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:29] [V] [TRT] Tactic: 0 Time: 0.085888 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1 Time: 0.085632 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2 Time: 0.120172 [05/21/2021-05:48:29] [V] [TRT] Tactic: 6 Time: 0.040064 [05/21/2021-05:48:29] [V] [TRT] Tactic: 56 Time: 0.08656 [05/21/2021-05:48:29] [V] [TRT] Tactic: 58 Time: 0.120052 [05/21/2021-05:48:29] [V] [TRT] Tactic: 62 Time: 0.040604 [05/21/2021-05:48:29] [V] [TRT] Fastest Tactic: 6 Time: 0.040064 [05/21/2021-05:48:29] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:29] [V] [TRT] Tactic: 254850674756030979 Time: 0.048256 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:48:29] [V] [TRT] Tactic: 328038211831149625 Time: 0.047104 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:48:29] [V] [TRT] Tactic: 411553864378931917 Time: 0.016384 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1011057357468998345 Time: 0.028344 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1156328698016730421 Time: 0.029048 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1723736032573714698 Time: 0.016168 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1832046141070096030 Time: 0.016536 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1838082074606840426 Time: 0.01652 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:29] [V] [TRT] Tactic: 1899296423087490472 Time: 0.011392 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2428167804343994714 Time: 0.0156 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0261 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01216 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2819719497590964443 Time: 0.017408 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2968605903460894194 Time: 0.016896 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:48:29] [V] [TRT] Tactic: 2986078304285316765 Time: 0.02744 [05/21/2021-05:48:29] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:30] [V] [TRT] Tactic: 3362537467505018070 Time: 0.026624 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:30] [V] [TRT] Tactic: 3513075359009385578 Time: 0.048088 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:48:30] [V] [TRT] Tactic: 3573559043797674382 Time: 0.017024 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:48:30] [V] [TRT] Tactic: 3591970081995419777 Time: 0.010216 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:30] [V] [TRT] Tactic: 3704534001553878387 Time: 0.026872 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:30] [V] [TRT] Tactic: 4278315135102886928 Time: 0.015608 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:48:30] [V] [TRT] Tactic: 4503233883285355107 Time: 0.01306 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:30] [V] [TRT] Tactic: 4802447371470387646 Time: 0.02984 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5059676457552313631 Time: 0.046336 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5368829646735632944 Time: 0.011392 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5398999388616959893 Time: 0.027676 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5746691132547383910 Time: 0.01652 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5770170567977052602 Time: 0.031744 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:48:30] [V] [TRT] Tactic: 5953552212833506549 Time: 0.025592 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01536 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6074229447555668232 Time: 0.011264 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6154447660803990543 Time: 0.015372 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6325769668000961702 Time: 0.027516 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6350273239113254096 Time: 0.010412 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6377497238381488891 Time: 0.02634 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6446388116965632819 Time: 0.016396 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6468794451065529747 Time: 0.016632 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6642277870194067185 Time: 0.048384 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011076 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6972489290272968208 Time: 0.026624 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:48:30] [V] [TRT] Tactic: 6979044990896381511 Time: 0.046208 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:30] [V] [TRT] Tactic: 7216571380637776659 Time: 0.031744 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:30] [V] [TRT] Tactic: 7609923741161019135 Time: 0.015532 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:48:30] [V] [TRT] Tactic: 7705739241028240201 Time: 0.01152 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:48:30] [V] [TRT] Tactic: 8072087735545283117 Time: 0.045944 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:30] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01216 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:30] [V] [TRT] Tactic: 8170606396342855895 Time: 0.016736 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:30] [V] [TRT] Tactic: 8839784824303350101 Time: 0.029056 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:48:30] [V] [TRT] Tactic: -9217371357561775773 Time: 0.012032 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:30] [V] [TRT] Tactic: -9009272790678027912 Time: 0.031812 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:48:30] [V] [TRT] Tactic: -8985224497679592364 Time: 0.012864 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:48:30] [V] [TRT] Tactic: -8949544755481315679 Time: 0.016832 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:48:30] [V] [TRT] Tactic: -8759929675070720385 Time: 0.026624 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:30] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01138 [05/21/2021-05:48:30] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6902925267326201166 Time: 0.009304 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6840588038605932325 Time: 0.016 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6799856376604253964 Time: 0.04506 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6625722781282978136 Time: 0.016512 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6525498856028268801 Time: 0.025984 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012248 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6324345858751792783 Time: 0.017536 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6262400699544994312 Time: 0.045836 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6257787336162086472 Time: 0.029312 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:31] [V] [TRT] Tactic: -6063766379489217211 Time: 0.016352 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5777580938094193096 Time: 0.016484 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5657273398217409378 Time: 0.047104 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5530886555766748586 Time: 0.026376 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5422685219138380548 Time: 0.016044 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5161596964442251102 Time: 0.016384 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:31] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01536 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4825567853927730435 Time: 0.015352 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01656 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4706569565442112734 Time: 0.012416 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4566599693570369588 Time: 0.026884 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4409144516525410768 Time: 0.02662 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4379519430184503304 Time: 0.015964 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4152066959007262150 Time: 0.047084 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:31] [V] [TRT] Tactic: -4021926646879732549 Time: 0.016 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3987638434926559037 Time: 0.016896 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3905653247016903130 Time: 0.028544 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3903974568488493144 Time: 0.01674 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3895429239811098010 Time: 0.015488 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3864869056275745423 Time: 0.029716 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011184 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3412636942650049698 Time: 0.02858 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3338665856053412950 Time: 0.027016 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:31] [V] [TRT] Tactic: -3058330359340425555 Time: 0.016384 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2816084650627734155 Time: 0.032048 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2662892962457732243 Time: 0.016284 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2559894581585337900 Time: 0.046848 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2530740716768816092 Time: 0.025576 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2332828394978346992 Time: 0.0256 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2241736083352441442 Time: 0.031872 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:48:31] [V] [TRT] Tactic: -2161909437867201546 Time: 0.010228 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:31] [V] [TRT] Tactic: -1985778916402815946 Time: 0.03072 [05/21/2021-05:48:31] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:48:32] [V] [TRT] Tactic: -1500496213132463076 Time: 0.017792 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:32] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011136 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:48:32] [V] [TRT] Tactic: -910286698936744682 Time: 0.011076 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:48:32] [V] [TRT] Tactic: -606726295133751039 Time: 0.0161 [05/21/2021-05:48:32] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.009304 [05/21/2021-05:48:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166 [05/21/2021-05:48:32] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution) [05/21/2021-05:48:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution) [05/21/2021-05:48:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudaDepthwiseConvolution) [05/21/2021-05:48:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (FusedConvActConvolution) [05/21/2021-05:48:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:32] [V] [TRT] Tactic: 0 Time: 0.03008 [05/21/2021-05:48:32] [V] [TRT] Tactic: 1 Time: 0.02928 [05/21/2021-05:48:32] [V] [TRT] Tactic: 2 Time: 0.069816 [05/21/2021-05:48:32] [V] [TRT] Tactic: 4 Time: 0.745312 [05/21/2021-05:48:32] [V] [TRT] Tactic: 5 Time: 0.073964 [05/21/2021-05:48:32] [V] [TRT] Tactic: 56 Time: 0.02984 [05/21/2021-05:48:32] [V] [TRT] Tactic: 57 Time: 0.02906 [05/21/2021-05:48:32] [V] [TRT] Tactic: 58 Time: 0.069652 [05/21/2021-05:48:32] [V] [TRT] Tactic: 60 Time: 0.747568 [05/21/2021-05:48:32] [V] [TRT] Tactic: 61 Time: 0.073544 [05/21/2021-05:48:32] [V] [TRT] Tactic: 112 Time: 0.028504 [05/21/2021-05:48:32] [V] [TRT] Tactic: 113 Time: 0.028288 [05/21/2021-05:48:32] [V] [TRT] Tactic: 114 Time: 0.053296 [05/21/2021-05:48:32] [V] [TRT] Tactic: 116 Time: 0.746792 [05/21/2021-05:48:32] [V] [TRT] Tactic: 117 Time: 0.073216 [05/21/2021-05:48:32] [V] [TRT] Fastest Tactic: 113 Time: 0.028288 [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:32] [V] [TRT] Tactic: 4549827808004681195 Time: 0.021504 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:32] [V] [TRT] Tactic: 5779835512569528575 Time: 0.024476 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:32] [V] [TRT] Tactic: 9151672657204310840 Time: 0.043396 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:32] [V] [TRT] Tactic: -7491730084094677098 Time: 0.027732 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:48:32] [V] [TRT] Tactic: -6622064180404051845 Time: 0.025564 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:32] [V] [TRT] Tactic: -6313876406580483184 Time: 0.022824 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:32] [V] [TRT] Tactic: -6273689210331812572 Time: 0.022528 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:32] [V] [TRT] Tactic: -4337126844824617177 Time: 0.018304 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:32] [V] [TRT] Tactic: -1123676555321336786 Time: 0.024432 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:32] [V] [TRT] Tactic: -701551393537224327 Time: 0.021804 [05/21/2021-05:48:32] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.018304 [05/21/2021-05:48:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177 [05/21/2021-05:48:32] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:32] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:32] [V] [TRT] Tactic: 1663866669559596164 Time: 0.025984 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:32] [V] [TRT] Tactic: 2860655430572478466 Time: 0.019148 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:32] [V] [TRT] Tactic: 4474630279712975759 Time: 0.020352 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:32] [V] [TRT] Tactic: 4479823862704990365 Time: 0.020084 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:32] [V] [TRT] Tactic: 4696204239951173149 Time: 0.015488 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:32] [V] [TRT] Tactic: 5778138195697110003 Time: 0.022528 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:32] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0205 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:32] [V] [TRT] Tactic: -5905193483742532701 Time: 0.018688 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:32] [V] [TRT] Tactic: -4035591156787122265 Time: 0.020096 [05/21/2021-05:48:32] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:32] [V] [TRT] Tactic: -2809379259463049391 Time: 0.025924 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:33] [V] [TRT] Tactic: -1985235291706575900 Time: 0.024532 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:33] [V] [TRT] Tactic: -504296718212024303 Time: 0.0247 [05/21/2021-05:48:33] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.015488 [05/21/2021-05:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149 [05/21/2021-05:48:33] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:33] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:33] [V] [TRT] Tactic: 1373022415249282411 Time: 0.020372 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:33] [V] [TRT] Tactic: 1663866669559596164 Time: 0.025556 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:33] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015636 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:33] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017516 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:33] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017432 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:33] [V] [TRT] Tactic: 4696204239951173149 Time: 0.019464 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:33] [V] [TRT] Tactic: 5778138195697110003 Time: 0.026396 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:33] [V] [TRT] Tactic: 8918020581761223752 Time: 0.024448 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:48:33] [V] [TRT] Tactic: -7067026478815706014 Time: 0.020216 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:33] [V] [TRT] Tactic: -5905193483742532701 Time: 0.018072 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:33] [V] [TRT] Tactic: -4035591156787122265 Time: 0.019752 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:33] [V] [TRT] Tactic: -2809379259463049391 Time: 0.026092 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:33] [V] [TRT] Tactic: -1985235291706575900 Time: 0.020636 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:33] [V] [TRT] Tactic: -504296718212024303 Time: 0.020864 [05/21/2021-05:48:33] [V] [TRT] Fastest Tactic: 2860655430572478466 Time: 0.015636 [05/21/2021-05:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2860655430572478466 [05/21/2021-05:48:33] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:33] [V] [TRT] Tactic: 0 Time: 0.018404 [05/21/2021-05:48:33] [V] [TRT] Tactic: 1 Time: 0.019232 [05/21/2021-05:48:33] [V] [TRT] Tactic: 2 Time: 0.052732 [05/21/2021-05:48:33] [V] [TRT] Tactic: 4 Time: 0.742408 [05/21/2021-05:48:33] [V] [TRT] Tactic: 5 Time: 0.073236 [05/21/2021-05:48:33] [V] [TRT] Tactic: 56 Time: 0.018852 [05/21/2021-05:48:33] [V] [TRT] Tactic: 58 Time: 0.053276 [05/21/2021-05:48:33] [V] [TRT] Tactic: 60 Time: 0.742684 [05/21/2021-05:48:33] [V] [TRT] Tactic: 61 Time: 0.073 [05/21/2021-05:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.018404 [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:48:33] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (FusedConvActConvolution) [05/21/2021-05:48:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:33] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:33] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:33] [V] [TRT] Tactic: 2195670545862694453 Time: 0.014348 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:33] [V] [TRT] Tactic: 3891805945559659536 Time: 0.015788 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:33] [V] [TRT] Tactic: 4418200634486186714 Time: 0.011716 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:33] [V] [TRT] Tactic: 5548126322150286555 Time: 0.012436 [05/21/2021-05:48:33] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:34] [V] [TRT] Tactic: 6057304366605292508 Time: 0.012272 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:34] [V] [TRT] Tactic: 7392644644614664811 Time: 0.013312 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:34] [V] [TRT] Tactic: -4884039206922900293 Time: 0.01664 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:34] [V] [TRT] Tactic: -4374269919094467161 Time: 0.01374 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:34] [V] [TRT] Tactic: -1546027692247304867 Time: 0.016744 [05/21/2021-05:48:34] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.011716 [05/21/2021-05:48:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:48:34] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:34] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudaDepthwiseConvolution) [05/21/2021-05:48:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:34] [V] [TRT] Tactic: 0 Time: 0.026992 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1 Time: 0.026256 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2 Time: 0.058368 [05/21/2021-05:48:34] [V] [TRT] Tactic: 56 Time: 0.028316 [05/21/2021-05:48:34] [V] [TRT] Tactic: 58 Time: 0.06072 [05/21/2021-05:48:34] [V] [TRT] Fastest Tactic: 1 Time: 0.026256 [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:34] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:34] [V] [TRT] Tactic: 254850674756030979 Time: 0.013952 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1156328698016730421 Time: 0.010624 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1362727228442059924 Time: 0.010628 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1576319725282257846 Time: 0.009264 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1832046141070096030 Time: 0.00924 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009464 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:34] [V] [TRT] Tactic: 1899296423087490472 Time: 0.01136 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2238656696610018305 Time: 0.008308 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2541579301352125276 Time: 0.009588 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2559328254295148085 Time: 0.011648 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01152 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:34] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009372 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3071479995783211391 Time: 0.01118 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009152 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3362537467505018070 Time: 0.010528 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3513075359009385578 Time: 0.013876 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0105 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:48:34] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009348 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:34] [V] [TRT] Tactic: 4278315135102886928 Time: 0.00816 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:48:34] [V] [TRT] Tactic: 4370476717970497892 Time: 0.007424 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:34] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007296 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:48:34] [V] [TRT] Tactic: 4491683531415781597 Time: 0.011264 [05/21/2021-05:48:34] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:48:35] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00976 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:35] [V] [TRT] Tactic: 4571819373777460444 Time: 0.01358 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:48:35] [V] [TRT] Tactic: 4595173549602041350 Time: 0.012908 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:35] [V] [TRT] Tactic: 4802447371470387646 Time: 0.010932 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:48:35] [V] [TRT] Tactic: 4993757826442493905 Time: 0.008376 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:35] [V] [TRT] Tactic: 5059676457552313631 Time: 0.013804 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:35] [V] [TRT] Tactic: 5205510332404400949 Time: 0.010208 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:35] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011208 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:35] [V] [TRT] Tactic: 5398999388616959893 Time: 0.01088 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:35] [V] [TRT] Tactic: 6034364043891107501 Time: 0.008368 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:35] [V] [TRT] Tactic: 6377497238381488891 Time: 0.010228 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:35] [V] [TRT] Tactic: 6468794451065529747 Time: 0.00896 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:48:35] [V] [TRT] Tactic: 6697277555581639516 Time: 0.007168 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:35] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00976 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:35] [V] [TRT] Tactic: 7216571380637776659 Time: 0.01024 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:35] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0085 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:35] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01146 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:35] [V] [TRT] Tactic: 8170606396342855895 Time: 0.009444 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:35] [V] [TRT] Tactic: 8764780417487154889 Time: 0.010716 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:48:35] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008828 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:35] [V] [TRT] Tactic: 8839784824303350101 Time: 0.010756 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:48:35] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00838 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:35] [V] [TRT] Tactic: -9009272790678027912 Time: 0.011292 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:35] [V] [TRT] Tactic: -8604374562669615024 Time: 0.010388 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:35] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0128 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:35] [V] [TRT] Tactic: -8205952393017864204 Time: 0.011744 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:35] [V] [TRT] Tactic: -8131857373260504832 Time: 0.00754 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:35] [V] [TRT] Tactic: -7410012245391920273 Time: 0.011288 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:35] [V] [TRT] Tactic: -7099920365135295801 Time: 0.007936 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:35] [V] [TRT] Tactic: -7089118800560870395 Time: 0.010156 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:48:35] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01024 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:35] [V] [TRT] Tactic: -6356316196810535311 Time: 0.011776 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:35] [V] [TRT] Tactic: -6063766379489217211 Time: 0.00896 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:35] [V] [TRT] Tactic: -5530886555766748586 Time: 0.010368 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:35] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008196 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:35] [V] [TRT] Tactic: -5161596964442251102 Time: 0.00896 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:35] [V] [TRT] Tactic: -5127240325355316006 Time: 0.007424 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008568 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4796511246675321840 Time: 0.00832 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4548822885169694805 Time: 0.010312 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00896 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4293222705763522367 Time: 0.009764 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4152066959007262150 Time: 0.013736 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:35] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008444 [05/21/2021-05:48:35] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009344 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3905653247016903130 Time: 0.011112 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3903342530518878192 Time: 0.010948 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3864869056275745423 Time: 0.010704 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010112 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:36] [V] [TRT] Tactic: -3058330359340425555 Time: 0.008348 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:48:36] [V] [TRT] Tactic: -2878731503146438856 Time: 0.009188 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:48:36] [V] [TRT] Tactic: -2602982885923184927 Time: 0.009728 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:48:36] [V] [TRT] Tactic: -2353603993968373338 Time: 0.010496 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:48:36] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009384 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:48:36] [V] [TRT] Tactic: -2003055242756584050 Time: 0.008148 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1985778916402815946 Time: 0.011256 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010996 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1640527254204634147 Time: 0.00906 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1562548049711204899 Time: 0.010228 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1242202084391243207 Time: 0.008456 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1099247066487349374 Time: 0.010316 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:48:36] [V] [TRT] Tactic: -1038291877007553549 Time: 0.008848 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:48:36] [V] [TRT] Tactic: -406984317033388136 Time: 0.00926 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:48:36] [V] [TRT] Tactic: -331499326992534460 Time: 0.007808 [05/21/2021-05:48:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:48:36] [V] [TRT] Tactic: -206523504474952360 Time: 0.010368 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 6697277555581639516 Time: 0.007168 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6697277555581639516 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution) [05/21/2021-05:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.005816 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005816 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.00574 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00574 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.006912 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006912 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CublasConvolution) [05/21/2021-05:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CublasConvolution) [05/21/2021-05:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CublasConvolution) [05/21/2021-05:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CudnnConvolution) [05/21/2021-05:48:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CublasConvolution) [05/21/2021-05:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CaskConvolution) [05/21/2021-05:48:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.0061 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0061 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.005956 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005956 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:36] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:36] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:36] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CublasConvolution) [05/21/2021-05:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CublasConvolution) [05/21/2021-05:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CublasConvolution) [05/21/2021-05:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CudnnConvolution) [05/21/2021-05:48:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CublasConvolution) [05/21/2021-05:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CaskConvolution) [05/21/2021-05:48:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Tactic: 0 Time: 0.00618 [05/21/2021-05:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00618 [05/21/2021-05:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Tactic: 0 Time: 0.0059 [05/21/2021-05:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0059 [05/21/2021-05:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Tactic: 0 Time: 0.006968 [05/21/2021-05:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006968 [05/21/2021-05:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale) [05/21/2021-05:48:37] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(200704,784,28,1) *************** [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:48:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:37] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:48:37] [V] [TRT] Tactic: 589823 Time: 0.112632 [05/21/2021-05:48:37] [V] [TRT] Tactic: 655359 Time: 0.073472 [05/21/2021-05:48:37] [V] [TRT] Tactic: 786431 Time: 0.03576 [05/21/2021-05:48:37] [V] [TRT] Tactic: 851967 Time: 0.031532 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1179647 Time: 0.028824 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1310719 Time: 0.061964 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1376255 Time: 0.086984 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1441791 Time: 0.034104 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1507327 Time: 0.048512 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1638399 Time: 0.032512 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1835007 Time: 0.041112 [05/21/2021-05:48:37] [V] [TRT] Tactic: 1900543 Time: 0.083456 [05/21/2021-05:48:37] [V] [TRT] Tactic: 2097151 Time: 0.029824 [05/21/2021-05:48:37] [V] [TRT] Tactic: 2162687 Time: 0.083976 [05/21/2021-05:48:37] [V] [TRT] Tactic: 2293759 Time: 0.079128 [05/21/2021-05:48:37] [V] [TRT] Tactic: 2359295 Time: 0.048788 [05/21/2021-05:48:37] [V] [TRT] Tactic: 2686975 Time: 0.079296 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3080191 Time: 0.042564 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3342335 Time: 0.049152 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3407871 Time: 0.048384 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3538943 Time: 0.035156 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3670015 Time: 0.137216 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3932159 Time: 0.065408 [05/21/2021-05:48:37] [V] [TRT] Tactic: 3997695 Time: 0.03392 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4063231 Time: 0.028672 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4194303 Time: 0.040236 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4259839 Time: 0.029952 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4325375 Time: 0.031924 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4521983 Time: 0.078336 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4587519 Time: 0.036172 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4653055 Time: 0.029056 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4915199 Time: 0.029348 [05/21/2021-05:48:37] [V] [TRT] Tactic: 4980735 Time: 0.047008 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5177343 Time: 0.029412 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5242879 Time: 0.045296 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5373951 Time: 0.035536 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5439487 Time: 0.045184 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5570559 Time: 0.048988 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5636095 Time: 0.03068 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5701631 Time: 0.07066 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5767167 Time: 0.072748 [05/21/2021-05:48:37] [V] [TRT] Tactic: 5832703 Time: 0.046212 [05/21/2021-05:48:38] [V] [TRT] Tactic: 5898239 Time: 0.023552 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6029311 Time: 0.070028 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6225919 Time: 0.033792 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6291455 Time: 0.03018 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6422527 Time: 0.043008 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6750207 Time: 0.03622 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6815743 Time: 0.050304 [05/21/2021-05:48:38] [V] [TRT] Tactic: 6946815 Time: 0.042924 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7012351 Time: 0.029788 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7077887 Time: 0.035712 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7143423 Time: 0.053588 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7208959 Time: 0.047656 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7340031 Time: 0.025472 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7405567 Time: 0.030272 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7536639 Time: 0.069992 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7602175 Time: 0.037312 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7733247 Time: 0.034176 [05/21/2021-05:48:38] [V] [TRT] Tactic: 7798783 Time: 0.03692 [05/21/2021-05:48:38] [V] [TRT] Tactic: 8191999 Time: 0.047104 [05/21/2021-05:48:38] [V] [TRT] Tactic: 8257535 Time: 0.029964 [05/21/2021-05:48:38] [V] [TRT] Tactic: 8323071 Time: 0.03856 [05/21/2021-05:48:38] [V] [TRT] Tactic: 8650751 Time: 0.036224 [05/21/2021-05:48:38] [V] [TRT] Tactic: 8716287 Time: 0.037808 [05/21/2021-05:48:38] [V] [TRT] Tactic: 9109503 Time: 0.029756 [05/21/2021-05:48:38] [V] [TRT] Tactic: 9568255 Time: 0.028824 [05/21/2021-05:48:38] [V] [TRT] Tactic: 9895935 Time: 0.036144 [05/21/2021-05:48:38] [V] [TRT] Tactic: 10223615 Time: 0.075012 [05/21/2021-05:48:38] [V] [TRT] Tactic: 10354687 Time: 0.034176 [05/21/2021-05:48:38] [V] [TRT] Tactic: 10551295 Time: 0.0512 [05/21/2021-05:48:38] [V] [TRT] Tactic: 10747903 Time: 0.032268 [05/21/2021-05:48:38] [V] [TRT] Tactic: 10944511 Time: 0.046688 [05/21/2021-05:48:38] [V] [TRT] Fastest Tactic: 5898239 Time: 0.023552 [05/21/2021-05:48:38] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:38] [V] [TRT] Tactic: 0 Time: 0.038216 [05/21/2021-05:48:38] [V] [TRT] Tactic: 1 Time: 0.03502 [05/21/2021-05:48:38] [V] [TRT] Tactic: 2 Time: 0.129404 [05/21/2021-05:48:38] [V] [TRT] Tactic: 4 Time: 1.7239 [05/21/2021-05:48:38] [V] [TRT] Tactic: 5 Time: 0.124524 [05/21/2021-05:48:38] [V] [TRT] Tactic: 56 Time: 0.038564 [05/21/2021-05:48:38] [V] [TRT] Tactic: 57 Time: 0.035256 [05/21/2021-05:48:38] [V] [TRT] Tactic: 58 Time: 0.12852 [05/21/2021-05:48:38] [V] [TRT] Tactic: 60 Time: 1.87363 [05/21/2021-05:48:38] [V] [TRT] Tactic: 61 Time: 0.125584 [05/21/2021-05:48:38] [V] [TRT] Tactic: 112 Time: 0.041688 [05/21/2021-05:48:38] [V] [TRT] Tactic: 113 Time: 0.035328 [05/21/2021-05:48:38] [V] [TRT] Tactic: 114 Time: 0.129204 [05/21/2021-05:48:38] [V] [TRT] Tactic: 116 Time: 1.72378 [05/21/2021-05:48:38] [V] [TRT] Tactic: 117 Time: 0.124556 [05/21/2021-05:48:39] [V] [TRT] Fastest Tactic: 1 Time: 0.03502 [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4549827808004681195 Time: 0.050456 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:39] [V] [TRT] Tactic: 5779835512569528575 Time: 0.06272 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:39] [V] [TRT] Tactic: 9151672657204310840 Time: 0.064696 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:39] [V] [TRT] Tactic: -7491730084094677098 Time: 0.059944 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:48:39] [V] [TRT] Tactic: -6622064180404051845 Time: 0.052276 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:39] [V] [TRT] Tactic: -6313876406580483184 Time: 0.06144 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:39] [V] [TRT] Tactic: -6273689210331812572 Time: 0.061952 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:39] [V] [TRT] Tactic: -4337126844824617177 Time: 0.047048 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:39] [V] [TRT] Tactic: -1123676555321336786 Time: 0.061796 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:39] [V] [TRT] Tactic: -701551393537224327 Time: 0.05208 [05/21/2021-05:48:39] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.047048 [05/21/2021-05:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239 [05/21/2021-05:48:39] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(200704,1,7168,256) *************** [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:39] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:39] [V] [TRT] Tactic: 1663866669559596164 Time: 0.064904 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:39] [V] [TRT] Tactic: 2860655430572478466 Time: 0.03892 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02458 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023552 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4696204239951173149 Time: 0.037632 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:39] [V] [TRT] Tactic: 5778138195697110003 Time: 0.064 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:39] [V] [TRT] Tactic: 8918020581761223752 Time: 0.058368 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:39] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034856 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:39] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023708 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:39] [V] [TRT] Tactic: -2809379259463049391 Time: 0.065108 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:39] [V] [TRT] Tactic: -1985235291706575900 Time: 0.059608 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:39] [V] [TRT] Tactic: -504296718212024303 Time: 0.059824 [05/21/2021-05:48:39] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.023552 [05/21/2021-05:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:39] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(50176,1:4,1792,64) *************** [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:39] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:39] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:39] [V] [TRT] Tactic: 1373022415249282411 Time: 0.044564 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:39] [V] [TRT] Tactic: 1663866669559596164 Time: 0.064604 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:39] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038016 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023592 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023552 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:39] [V] [TRT] Tactic: 4696204239951173149 Time: 0.038468 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:39] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06592 [05/21/2021-05:48:39] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:40] [V] [TRT] Tactic: 8918020581761223752 Time: 0.059388 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:48:40] [V] [TRT] Tactic: -7067026478815706014 Time: 0.04544 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:40] [V] [TRT] Tactic: -5905193483742532701 Time: 0.03468 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:40] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023816 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:40] [V] [TRT] Tactic: -2809379259463049391 Time: 0.065208 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:40] [V] [TRT] Tactic: -1985235291706575900 Time: 0.059392 [05/21/2021-05:48:40] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:40] [V] [TRT] Tactic: -504296718212024303 Time: 0.060244 [05/21/2021-05:48:40] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.023552 [05/21/2021-05:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:40] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(200704,784,28,1) *************** [05/21/2021-05:48:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:40] [V] [TRT] Tactic: 0 Time: 0.040136 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1 Time: 0.049288 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2 Time: 0.104372 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4 Time: 1.43764 [05/21/2021-05:48:40] [V] [TRT] Tactic: 5 Time: 0.121308 [05/21/2021-05:48:40] [V] [TRT] Tactic: 56 Time: 0.045312 [05/21/2021-05:48:40] [V] [TRT] Tactic: 58 Time: 0.107776 [05/21/2021-05:48:40] [V] [TRT] Tactic: 60 Time: 1.43723 [05/21/2021-05:48:40] [V] [TRT] Tactic: 61 Time: 0.123168 [05/21/2021-05:48:40] [V] [TRT] Fastest Tactic: 0 Time: 0.040136 [05/21/2021-05:48:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:48:40] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784,28,1) *************** [05/21/2021-05:48:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:40] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784:2,28,1) *************** [05/21/2021-05:48:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:48:40] [V] [TRT] Tactic: 589823 Time: 0.059904 [05/21/2021-05:48:40] [V] [TRT] Tactic: 655359 Time: 0.04424 [05/21/2021-05:48:40] [V] [TRT] Tactic: 786431 Time: 0.021632 [05/21/2021-05:48:40] [V] [TRT] Tactic: 851967 Time: 0.023504 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1179647 Time: 0.017792 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1310719 Time: 0.033284 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1376255 Time: 0.045992 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1441791 Time: 0.01856 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1507327 Time: 0.027656 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1638399 Time: 0.01752 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1835007 Time: 0.022536 [05/21/2021-05:48:40] [V] [TRT] Tactic: 1900543 Time: 0.047104 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2097151 Time: 0.01756 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2162687 Time: 0.046124 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2293759 Time: 0.049696 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2359295 Time: 0.028032 [05/21/2021-05:48:40] [V] [TRT] Tactic: 2686975 Time: 0.04288 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3080191 Time: 0.024788 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3342335 Time: 0.028268 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3407871 Time: 0.026256 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3538943 Time: 0.020328 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3670015 Time: 0.081068 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3932159 Time: 0.037412 [05/21/2021-05:48:40] [V] [TRT] Tactic: 3997695 Time: 0.018992 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4063231 Time: 0.018272 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4194303 Time: 0.020736 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4259839 Time: 0.017584 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4325375 Time: 0.017408 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4521983 Time: 0.042012 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4587519 Time: 0.018608 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4653055 Time: 0.017664 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4915199 Time: 0.01664 [05/21/2021-05:48:40] [V] [TRT] Tactic: 4980735 Time: 0.023576 [05/21/2021-05:48:40] [V] [TRT] Tactic: 5177343 Time: 0.01746 [05/21/2021-05:48:40] [V] [TRT] Tactic: 5242879 Time: 0.025372 [05/21/2021-05:48:40] [V] [TRT] Tactic: 5373951 Time: 0.020484 [05/21/2021-05:48:40] [V] [TRT] Tactic: 5439487 Time: 0.025508 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5570559 Time: 0.027392 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5636095 Time: 0.01832 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5701631 Time: 0.040528 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5767167 Time: 0.038624 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5832703 Time: 0.026496 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5898239 Time: 0.018432 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6029311 Time: 0.039648 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6225919 Time: 0.01956 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6291455 Time: 0.017876 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6422527 Time: 0.023472 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6750207 Time: 0.02062 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6815743 Time: 0.027124 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6946815 Time: 0.024736 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7012351 Time: 0.018096 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7077887 Time: 0.019432 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7143423 Time: 0.029184 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7208959 Time: 0.026204 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7340031 Time: 0.017736 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7405567 Time: 0.0177 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7536639 Time: 0.036688 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7602175 Time: 0.02116 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7733247 Time: 0.017892 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7798783 Time: 0.022404 [05/21/2021-05:48:41] [V] [TRT] Tactic: 8191999 Time: 0.023936 [05/21/2021-05:48:41] [V] [TRT] Tactic: 8257535 Time: 0.017024 [05/21/2021-05:48:41] [V] [TRT] Tactic: 8323071 Time: 0.022648 [05/21/2021-05:48:41] [V] [TRT] Tactic: 8650751 Time: 0.021504 [05/21/2021-05:48:41] [V] [TRT] Tactic: 8716287 Time: 0.021656 [05/21/2021-05:48:41] [V] [TRT] Tactic: 9109503 Time: 0.01754 [05/21/2021-05:48:41] [V] [TRT] Tactic: 9568255 Time: 0.01692 [05/21/2021-05:48:41] [V] [TRT] Tactic: 9895935 Time: 0.020968 [05/21/2021-05:48:41] [V] [TRT] Tactic: 10223615 Time: 0.042624 [05/21/2021-05:48:41] [V] [TRT] Tactic: 10354687 Time: 0.017384 [05/21/2021-05:48:41] [V] [TRT] Tactic: 10551295 Time: 0.028936 [05/21/2021-05:48:41] [V] [TRT] Tactic: 10747903 Time: 0.018012 [05/21/2021-05:48:41] [V] [TRT] Tactic: 10944511 Time: 0.024104 [05/21/2021-05:48:41] [V] [TRT] Fastest Tactic: 4915199 Time: 0.01664 [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:41] [V] [TRT] Tactic: 2195670545862694453 Time: 0.029696 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:41] [V] [TRT] Tactic: 3891805945559659536 Time: 0.041756 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:41] [V] [TRT] Tactic: 4418200634486186714 Time: 0.025616 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:41] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029076 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:41] [V] [TRT] Tactic: 6057304366605292508 Time: 0.027824 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:41] [V] [TRT] Tactic: 7392644644614664811 Time: 0.026916 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:41] [V] [TRT] Tactic: -4884039206922900293 Time: 0.040988 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:41] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028008 [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:41] [V] [TRT] Tactic: -1546027692247304867 Time: 0.041832 [05/21/2021-05:48:41] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.025616 [05/21/2021-05:48:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4915199 [05/21/2021-05:48:41] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(200704,784,28,1) *************** [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(25088,1:8,896,32) *************** [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:48:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:41] [V] [TRT] Tactic: 0 Time: 0.057908 [05/21/2021-05:48:41] [V] [TRT] Tactic: 1 Time: 0.054696 [05/21/2021-05:48:41] [V] [TRT] Tactic: 2 Time: 0.115072 [05/21/2021-05:48:41] [V] [TRT] Tactic: 56 Time: 0.05888 [05/21/2021-05:48:41] [V] [TRT] Tactic: 58 Time: 0.11422 [05/21/2021-05:48:41] [V] [TRT] Fastest Tactic: 1 Time: 0.054696 [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:41] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:42] [V] [TRT] Tactic: 254850674756030979 Time: 0.025436 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1156328698016730421 Time: 0.016948 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017792 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011696 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011264 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011204 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:42] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0091 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:42] [V] [TRT] Tactic: 2238656696610018305 Time: 0.010624 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:42] [V] [TRT] Tactic: 2541579301352125276 Time: 0.015376 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:42] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0238 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:42] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009384 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:42] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011276 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3071479995783211391 Time: 0.011944 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011388 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01568 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3513075359009385578 Time: 0.025716 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3704534001553878387 Time: 0.015956 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:48:42] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00822 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4278315135102886928 Time: 0.010264 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4370476717970497892 Time: 0.010384 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009728 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4491683531415781597 Time: 0.023808 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4528997467275241200 Time: 0.016 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025616 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4595173549602041350 Time: 0.024668 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4802447371470387646 Time: 0.017856 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:48:42] [V] [TRT] Tactic: 4993757826442493905 Time: 0.01024 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:42] [V] [TRT] Tactic: 5059676457552313631 Time: 0.025072 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:42] [V] [TRT] Tactic: 5205510332404400949 Time: 0.01542 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:42] [V] [TRT] Tactic: 5346855796032465921 Time: 0.016512 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:42] [V] [TRT] Tactic: 5398999388616959893 Time: 0.01664 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:42] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01024 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:42] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01536 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:42] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011268 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:48:42] [V] [TRT] Tactic: 6697277555581639516 Time: 0.010392 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:42] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00886 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:42] [V] [TRT] Tactic: 7216571380637776659 Time: 0.018548 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:42] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010752 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:42] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009344 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:42] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011884 [05/21/2021-05:48:42] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:43] [V] [TRT] Tactic: 8764780417487154889 Time: 0.016512 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:48:43] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010752 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:43] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0178 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:48:43] [V] [TRT] Tactic: -9203179519031456182 Time: 0.008216 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:43] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018432 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:43] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00896 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:43] [V] [TRT] Tactic: -8280443484414412687 Time: 0.024576 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:43] [V] [TRT] Tactic: -8205952393017864204 Time: 0.023796 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:43] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011564 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:43] [V] [TRT] Tactic: -7410012245391920273 Time: 0.009344 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:43] [V] [TRT] Tactic: -7099920365135295801 Time: 0.010412 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:43] [V] [TRT] Tactic: -7089118800560870395 Time: 0.008652 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:48:43] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01558 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:43] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009448 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:43] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011288 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:43] [V] [TRT] Tactic: -5530886555766748586 Time: 0.015376 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:43] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00832 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:43] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011392 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:43] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010496 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008704 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011232 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00856 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010728 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4293222705763522367 Time: 0.008384 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4152066959007262150 Time: 0.025088 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:43] [V] [TRT] Tactic: -4021926646879732549 Time: 0.010344 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011264 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3905653247016903130 Time: 0.017348 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3903342530518878192 Time: 0.017408 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01738 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008852 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:43] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011112 [05/21/2021-05:48:43] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:48:43] [V] [TRT] Tactic: -2878731503146438856 Time: 0.014616 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:48:44] [V] [TRT] Tactic: -2602982885923184927 Time: 0.016424 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:48:44] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01814 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:48:44] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011392 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:48:44] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010416 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:44] [V] [TRT] Tactic: -1985778916402815946 Time: 0.018176 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:48:44] [V] [TRT] Tactic: -1828674067637788567 Time: 0.012072 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:48:44] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011124 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:48:44] [V] [TRT] Tactic: -1562548049711204899 Time: 0.015872 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:48:44] [V] [TRT] Tactic: -1242202084391243207 Time: 0.010608 [05/21/2021-05:48:44] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:45] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00882 [05/21/2021-05:48:45] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:48:45] [V] [TRT] Tactic: -1038291877007553549 Time: 0.010524 [05/21/2021-05:48:45] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:48:45] [V] [TRT] Tactic: -406984317033388136 Time: 0.016 [05/21/2021-05:48:45] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:48:45] [V] [TRT] Tactic: -331499326992534460 Time: 0.010496 [05/21/2021-05:48:45] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:48:45] [V] [TRT] Tactic: -206523504474952360 Time: 0.016092 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.008216 [05/21/2021-05:48:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182 [05/21/2021-05:48:45] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(12544,1:16,448,16) *************** [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution) [05/21/2021-05:48:45] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution) [05/21/2021-05:48:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution) [05/21/2021-05:48:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.01016 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007108 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007108 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.01016 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007204 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007204 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007468 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.00736 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.004132 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.00632 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.006424 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006424 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.010368 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007552 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007552 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.009368 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.005192 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005192 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007488 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006796 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006796 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006656 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006656 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.006316 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.005348 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005348 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.0052 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0052 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.011136 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.00694 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00694 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.009472 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.005332 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005332 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.00726 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006788 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006788 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007408 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006744 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006744 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.008864 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.005356 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.005356 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007596 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.00722 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00722 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.00782 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007376 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007376 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.010272 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.00888 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.004296 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004296 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.008996 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.007148 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007148 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.008832 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.008116 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007936 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.006232 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006232 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.012092 [05/21/2021-05:48:45] [V] [TRT] Tactic: 0 Time: 0.004528 [05/21/2021-05:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004528 [05/21/2021-05:48:45] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:45] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.00832 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.005208 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005208 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.0062 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.005652 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005652 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.009384 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.003972 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.003972 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.00734 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.003984 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.003984 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(12544,1:16,448,16) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.005352 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005352 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(200704,784,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.006304 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(200704,1,7168,256) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(50176,1:4,1792,64) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.006168 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(200704,784,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.009728 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.007048 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.007048 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(100352,784:2,28,1) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.007964 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.00714 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00714 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(25088,1:8,896,32) (Reformat) [05/21/2021-05:48:46] [V] [TRT] Tactic: 1002 Time: 0.007012 [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.005896 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005896 [05/21/2021-05:48:46] [V] [TRT] *************** Autotuning format combination: Float(200704,784,28,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:48:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:48:46] [V] [TRT] Tactic: 458751 Time: 0.156232 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 458751 Time: 0.156232 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:46] [V] [TRT] Tactic: 0 Time: 0.134656 [05/21/2021-05:48:46] [V] [TRT] Tactic: 1 Time: 0.06992 [05/21/2021-05:48:46] [V] [TRT] Tactic: 2 Time: 0.16558 [05/21/2021-05:48:46] [V] [TRT] Tactic: 5 Time: 0.748288 [05/21/2021-05:48:46] [V] [TRT] Tactic: 56 Time: 0.133456 [05/21/2021-05:48:46] [V] [TRT] Tactic: 57 Time: 0.069952 [05/21/2021-05:48:46] [V] [TRT] Tactic: 58 Time: 0.165248 [05/21/2021-05:48:46] [V] [TRT] Tactic: 61 Time: 0.747984 [05/21/2021-05:48:46] [V] [TRT] Tactic: 112 Time: 0.13404 [05/21/2021-05:48:46] [V] [TRT] Tactic: 113 Time: 0.110444 [05/21/2021-05:48:46] [V] [TRT] Tactic: 114 Time: 0.100736 [05/21/2021-05:48:46] [V] [TRT] Tactic: 117 Time: 0.746804 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 1 Time: 0.06992 [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:46] [V] [TRT] Tactic: 4549827808004681195 Time: 0.19254 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:46] [V] [TRT] Tactic: 5779835512569528575 Time: 0.249868 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:48:46] [V] [TRT] Tactic: 6053873026024413720 Time: 0.25576 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:48:46] [V] [TRT] Tactic: 6767548733843469815 Time: 0.20032 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:46] [V] [TRT] Tactic: -6313876406580483184 Time: 0.268416 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:46] [V] [TRT] Tactic: -1123676555321336786 Time: 0.251116 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:46] [V] [TRT] Tactic: -701551393537224327 Time: 0.21644 [05/21/2021-05:48:46] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.19254 [05/21/2021-05:48:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:48:46] [V] [TRT] *************** Autotuning format combination: Float(200704,1,7168,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:46] [V] [TRT] Tactic: 2860655430572478466 Time: 0.146472 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:46] [V] [TRT] Tactic: 4474630279712975759 Time: 0.080916 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:46] [V] [TRT] Tactic: 4479823862704990365 Time: 0.079004 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:46] [V] [TRT] Tactic: 4696204239951173149 Time: 0.145664 [05/21/2021-05:48:46] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:47] [V] [TRT] Tactic: 5778138195697110003 Time: 0.263304 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:48:47] [V] [TRT] Tactic: 7155825427510256858 Time: 0.245908 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:47] [V] [TRT] Tactic: 8918020581761223752 Time: 0.241832 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:48:47] [V] [TRT] Tactic: -4756382386362004279 Time: 0.144984 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:48:47] [V] [TRT] Tactic: -3855385237722507464 Time: 0.267564 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:47] [V] [TRT] Tactic: -2809379259463049391 Time: 0.261984 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:47] [V] [TRT] Tactic: -504296718212024303 Time: 0.241196 [05/21/2021-05:48:47] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.079004 [05/21/2021-05:48:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:47] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,1792,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:47] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:47] [V] [TRT] Tactic: 2860655430572478466 Time: 0.146672 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:47] [V] [TRT] Tactic: 4474630279712975759 Time: 0.081152 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:47] [V] [TRT] Tactic: 4479823862704990365 Time: 0.079788 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:47] [V] [TRT] Tactic: 4696204239951173149 Time: 0.146784 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:47] [V] [TRT] Tactic: 5778138195697110003 Time: 0.266308 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:48:47] [V] [TRT] Tactic: 7155825427510256858 Time: 0.243968 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:48:47] [V] [TRT] Tactic: 7342025736444949634 Time: 0.166656 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:47] [V] [TRT] Tactic: 8918020581761223752 Time: 0.239704 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:48:47] [V] [TRT] Tactic: -7377458734869418330 Time: 0.16576 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:48:47] [V] [TRT] Tactic: -5457304872213719461 Time: 0.174124 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:48:47] [V] [TRT] Tactic: -4756382386362004279 Time: 0.146604 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:48:47] [V] [TRT] Tactic: -3855385237722507464 Time: 0.26754 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:47] [V] [TRT] Tactic: -2809379259463049391 Time: 0.262888 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:47] [V] [TRT] Tactic: -504296718212024303 Time: 0.241572 [05/21/2021-05:48:47] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.079788 [05/21/2021-05:48:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:47] [V] [TRT] *************** Autotuning format combination: Half(200704,784,28,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:47] [V] [TRT] Tactic: 0 Time: 0.11712 [05/21/2021-05:48:47] [V] [TRT] Tactic: 1 Time: 0.11648 [05/21/2021-05:48:47] [V] [TRT] Tactic: 2 Time: 0.143988 [05/21/2021-05:48:47] [V] [TRT] Tactic: 5 Time: 0.73848 [05/21/2021-05:48:47] [V] [TRT] Tactic: 56 Time: 0.118916 [05/21/2021-05:48:47] [V] [TRT] Tactic: 58 Time: 0.141312 [05/21/2021-05:48:47] [V] [TRT] Tactic: 61 Time: 0.738888 [05/21/2021-05:48:47] [V] [TRT] Fastest Tactic: 1 Time: 0.11648 [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:48:47] [V] [TRT] *************** Autotuning format combination: Half(100352,784:2,28,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:48:47] [V] [TRT] Tactic: 458751 Time: 0.079444 [05/21/2021-05:48:47] [V] [TRT] Fastest Tactic: 458751 Time: 0.079444 [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:47] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:47] [V] [TRT] Tactic: 2195670545862694453 Time: 0.118016 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:48:47] [V] [TRT] Tactic: 3419182076704469245 Time: 0.114532 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:47] [V] [TRT] Tactic: 3891805945559659536 Time: 0.163216 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:47] [V] [TRT] Tactic: 5548126322150286555 Time: 0.110832 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:47] [V] [TRT] Tactic: 6057304366605292508 Time: 0.1 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:48:47] [V] [TRT] Tactic: -7928611605886347652 Time: 0.168764 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:48:47] [V] [TRT] Tactic: -5172391392092686714 Time: 0.125568 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:47] [V] [TRT] Tactic: -4374269919094467161 Time: 0.099328 [05/21/2021-05:48:47] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:47] [V] [TRT] Tactic: -1546027692247304867 Time: 0.16448 [05/21/2021-05:48:47] [V] [TRT] Fastest Tactic: -4374269919094467161 Time: 0.099328 [05/21/2021-05:48:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [05/21/2021-05:48:47] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,896,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:47] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,896,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:48:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:47] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:48] [V] [TRT] Tactic: 0 Time: 0.135168 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1 Time: 0.130176 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2 Time: 0.140308 [05/21/2021-05:48:48] [V] [TRT] Tactic: 56 Time: 0.12932 [05/21/2021-05:48:48] [V] [TRT] Tactic: 58 Time: 0.138204 [05/21/2021-05:48:48] [V] [TRT] Fastest Tactic: 56 Time: 0.12932 [05/21/2021-05:48:48] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:48] [V] [TRT] Tactic: 254850674756030979 Time: 0.085496 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:48:48] [V] [TRT] Tactic: 328038211831149625 Time: 0.084248 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:48:48] [V] [TRT] Tactic: 411553864378931917 Time: 0.026292 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1011057357468998345 Time: 0.049308 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1156328698016730421 Time: 0.051752 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1723736032573714698 Time: 0.024672 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0256 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1838082074606840426 Time: 0.026752 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:48] [V] [TRT] Tactic: 1899296423087490472 Time: 0.01664 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2428167804343994714 Time: 0.027288 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2541579301352125276 Time: 0.047116 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2657157263811141609 Time: 0.016808 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2819719497590964443 Time: 0.027136 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2968605903460894194 Time: 0.026396 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:48:48] [V] [TRT] Tactic: 2986078304285316765 Time: 0.04842 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:48] [V] [TRT] Tactic: 3362537467505018070 Time: 0.045612 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:48] [V] [TRT] Tactic: 3513075359009385578 Time: 0.087108 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:48:48] [V] [TRT] Tactic: 3573559043797674382 Time: 0.026612 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:48:48] [V] [TRT] Tactic: 3591970081995419777 Time: 0.014968 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:48] [V] [TRT] Tactic: 3704534001553878387 Time: 0.048 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:48] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0256 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:48:48] [V] [TRT] Tactic: 4503233883285355107 Time: 0.0195 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:48] [V] [TRT] Tactic: 4802447371470387646 Time: 0.049664 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5059676457552313631 Time: 0.084924 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5368829646735632944 Time: 0.01722 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5398999388616959893 Time: 0.048124 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5746691132547383910 Time: 0.026844 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5770170567977052602 Time: 0.052192 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:48:48] [V] [TRT] Tactic: 5953552212833506549 Time: 0.046 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:48] [V] [TRT] Tactic: 6034364043891107501 Time: 0.024976 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:48:48] [V] [TRT] Tactic: 6074229447555668232 Time: 0.016768 [05/21/2021-05:48:48] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:48:48] [V] [TRT] Tactic: 6154447660803990543 Time: 0.026612 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6325769668000961702 Time: 0.0463 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6350273239113254096 Time: 0.01408 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6377497238381488891 Time: 0.045548 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6446388116965632819 Time: 0.026788 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6468794451065529747 Time: 0.025856 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6642277870194067185 Time: 0.087248 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6859477213531075460 Time: 0.016768 [05/21/2021-05:48:49] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:48:49] [V] [TRT] Tactic: 6972489290272968208 Time: 0.04606 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:48:50] [V] [TRT] Tactic: 6979044990896381511 Time: 0.084216 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:50] [V] [TRT] Tactic: 7216571380637776659 Time: 0.057728 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:50] [V] [TRT] Tactic: 7609923741161019135 Time: 0.02624 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:48:50] [V] [TRT] Tactic: 7705739241028240201 Time: 0.017968 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:48:50] [V] [TRT] Tactic: 8072087735545283117 Time: 0.086408 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:50] [V] [TRT] Tactic: 8101703987960976805 Time: 0.017408 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:50] [V] [TRT] Tactic: 8170606396342855895 Time: 0.02626 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:50] [V] [TRT] Tactic: 8839784824303350101 Time: 0.051564 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:48:50] [V] [TRT] Tactic: -9217371357561775773 Time: 0.017664 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:50] [V] [TRT] Tactic: -9009272790678027912 Time: 0.054164 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:48:50] [V] [TRT] Tactic: -8985224497679592364 Time: 0.01996 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:48:50] [V] [TRT] Tactic: -8949544755481315679 Time: 0.02712 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:48:50] [V] [TRT] Tactic: -8759929675070720385 Time: 0.046452 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:50] [V] [TRT] Tactic: -8604374562669615024 Time: 0.017076 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013684 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6840588038605932325 Time: 0.026464 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6799856376604253964 Time: 0.084608 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6625722781282978136 Time: 0.025216 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6525498856028268801 Time: 0.045512 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6356316196810535311 Time: 0.017408 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6324345858751792783 Time: 0.027008 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6262400699544994312 Time: 0.085144 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6257787336162086472 Time: 0.052268 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:50] [V] [TRT] Tactic: -6063766379489217211 Time: 0.026436 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5777580938094193096 Time: 0.027264 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5657273398217409378 Time: 0.0864 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5530886555766748586 Time: 0.046848 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5422685219138380548 Time: 0.024576 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5161596964442251102 Time: 0.025608 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:50] [V] [TRT] Tactic: -5127240325355316006 Time: 0.02482 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:48:50] [V] [TRT] Tactic: -4825567853927730435 Time: 0.026616 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:50] [V] [TRT] Tactic: -4796511246675321840 Time: 0.026612 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:48:50] [V] [TRT] Tactic: -4706569565442112734 Time: 0.01792 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:48:50] [V] [TRT] Tactic: -4566599693570369588 Time: 0.046224 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:48:50] [V] [TRT] Tactic: -4409144516525410768 Time: 0.045956 [05/21/2021-05:48:50] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:51] [V] [TRT] Tactic: -4379519430184503304 Time: 0.02596 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:48:51] [V] [TRT] Tactic: -4152066959007262150 Time: 0.086108 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:48:51] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0256 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3987638434926559037 Time: 0.026084 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3905653247016903130 Time: 0.048768 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3903974568488493144 Time: 0.02986 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3895429239811098010 Time: 0.02634 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3864869056275745423 Time: 0.049024 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3601464762214218301 Time: 0.016652 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3412636942650049698 Time: 0.049716 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3338665856053412950 Time: 0.04608 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:48:51] [V] [TRT] Tactic: -3058330359340425555 Time: 0.026196 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2816084650627734155 Time: 0.053888 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2662892962457732243 Time: 0.024564 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2559894581585337900 Time: 0.084976 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2530740716768816092 Time: 0.04338 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2332828394978346992 Time: 0.044928 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2241736083352441442 Time: 0.062552 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:48:51] [V] [TRT] Tactic: -2161909437867201546 Time: 0.016168 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:48:51] [V] [TRT] Tactic: -1985778916402815946 Time: 0.051456 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:48:51] [V] [TRT] Tactic: -1500496213132463076 Time: 0.02762 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:48:51] [V] [TRT] Tactic: -1099247066487349374 Time: 0.01724 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:48:51] [V] [TRT] Tactic: -910286698936744682 Time: 0.016256 [05/21/2021-05:48:51] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:48:51] [V] [TRT] Tactic: -606726295133751039 Time: 0.027124 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.013684 [05/21/2021-05:48:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166 [05/21/2021-05:48:51] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,448,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution) [05/21/2021-05:48:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution) [05/21/2021-05:48:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.010532 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004628 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004628 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.009204 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.015384 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.00408 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.00408 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.006884 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.01124 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.007788 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004684 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004684 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.00722 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:51] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:48:51] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:48:51] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:51] [V] [TRT] Tactic: 1002 Time: 0.00512 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004076 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004076 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.005376 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.011456 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.005056 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.005056 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007668 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004832 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004832 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.0061 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006096 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.00414 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00414 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.015484 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.00668 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.00452 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00452 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003764 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003764 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.00836 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004556 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004556 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.008212 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.005084 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.005084 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.008068 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003624 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003624 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007528 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.010496 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003904 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003904 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003856 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003856 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004088 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004088 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007692 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006304 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.008448 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004132 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007124 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(3136,1:16,224,16) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.006596 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.0047 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.0047 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004356 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004356 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(50176,1,3584,256) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.005676 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(12544,1:4,896,64) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.005884 [05/21/2021-05:48:52] [V] [TRT] Tactic: 0 Time: 0.004228 [05/21/2021-05:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.004228 [05/21/2021-05:48:52] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(50176,196,14,1) (Reformat) [05/21/2021-05:48:52] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:48:53] [V] [TRT] Tactic: 0 Time: 0.005228 [05/21/2021-05:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.005228 [05/21/2021-05:48:53] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(25088,196:2,14,1) (Reformat) [05/21/2021-05:48:53] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:48:53] [V] [TRT] Tactic: 0 Time: 0.005116 [05/21/2021-05:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.005116 [05/21/2021-05:48:53] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(6272,1:8,448,32) (Reformat) [05/21/2021-05:48:53] [V] [TRT] Tactic: 1002 Time: 0.006828 [05/21/2021-05:48:53] [V] [TRT] Tactic: 0 Time: 0.004776 [05/21/2021-05:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004776 [05/21/2021-05:48:53] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:48:53] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:48:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:53] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:48:53] [V] [TRT] Tactic: 589823 Time: 0.061988 [05/21/2021-05:48:53] [V] [TRT] Tactic: 655359 Time: 0.041556 [05/21/2021-05:48:53] [V] [TRT] Tactic: 786431 Time: 0.022816 [05/21/2021-05:48:53] [V] [TRT] Tactic: 851967 Time: 0.020748 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1179647 Time: 0.020444 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1310719 Time: 0.032484 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1376255 Time: 0.04416 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1441791 Time: 0.021664 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1507327 Time: 0.028544 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1638399 Time: 0.024576 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1835007 Time: 0.025204 [05/21/2021-05:48:53] [V] [TRT] Tactic: 1900543 Time: 0.044364 [05/21/2021-05:48:53] [V] [TRT] Tactic: 2097151 Time: 0.021004 [05/21/2021-05:48:53] [V] [TRT] Tactic: 2162687 Time: 0.044144 [05/21/2021-05:48:53] [V] [TRT] Tactic: 2293759 Time: 0.042968 [05/21/2021-05:48:53] [V] [TRT] Tactic: 2359295 Time: 0.029056 [05/21/2021-05:48:53] [V] [TRT] Tactic: 2686975 Time: 0.044152 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3080191 Time: 0.02514 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3342335 Time: 0.028416 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3407871 Time: 0.028872 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3538943 Time: 0.023168 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3670015 Time: 0.073104 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3932159 Time: 0.038904 [05/21/2021-05:48:53] [V] [TRT] Tactic: 3997695 Time: 0.01976 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4063231 Time: 0.019456 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4194303 Time: 0.023212 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4259839 Time: 0.021128 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4325375 Time: 0.022604 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4521983 Time: 0.042012 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4587519 Time: 0.021036 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4653055 Time: 0.018432 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4915199 Time: 0.02036 [05/21/2021-05:48:53] [V] [TRT] Tactic: 4980735 Time: 0.028288 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5177343 Time: 0.025088 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5242879 Time: 0.027148 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5373951 Time: 0.021936 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5439487 Time: 0.024216 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5570559 Time: 0.028192 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5636095 Time: 0.019632 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5701631 Time: 0.041348 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5767167 Time: 0.032624 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5832703 Time: 0.027776 [05/21/2021-05:48:53] [V] [TRT] Tactic: 5898239 Time: 0.018708 [05/21/2021-05:48:53] [V] [TRT] Tactic: 6029311 Time: 0.039808 [05/21/2021-05:48:53] [V] [TRT] Tactic: 6225919 Time: 0.021956 [05/21/2021-05:48:53] [V] [TRT] Tactic: 6291455 Time: 0.02048 [05/21/2021-05:48:53] [V] [TRT] Tactic: 6422527 Time: 0.025016 [05/21/2021-05:48:54] [V] [TRT] Tactic: 6750207 Time: 0.021852 [05/21/2021-05:48:54] [V] [TRT] Tactic: 6815743 Time: 0.027648 [05/21/2021-05:48:54] [V] [TRT] Tactic: 6946815 Time: 0.02398 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7012351 Time: 0.021088 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7077887 Time: 0.022752 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7143423 Time: 0.031928 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7208959 Time: 0.028416 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7340031 Time: 0.020012 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7405567 Time: 0.02048 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7536639 Time: 0.038444 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7602175 Time: 0.023132 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7733247 Time: 0.023536 [05/21/2021-05:48:54] [V] [TRT] Tactic: 7798783 Time: 0.022592 [05/21/2021-05:48:54] [V] [TRT] Tactic: 8191999 Time: 0.02752 [05/21/2021-05:48:54] [V] [TRT] Tactic: 8257535 Time: 0.021456 [05/21/2021-05:48:54] [V] [TRT] Tactic: 8323071 Time: 0.023556 [05/21/2021-05:48:54] [V] [TRT] Tactic: 8650751 Time: 0.024712 [05/21/2021-05:48:54] [V] [TRT] Tactic: 8716287 Time: 0.02274 [05/21/2021-05:48:55] [V] [TRT] Tactic: 9109503 Time: 0.021508 [05/21/2021-05:48:55] [V] [TRT] Tactic: 9568255 Time: 0.020448 [05/21/2021-05:48:55] [V] [TRT] Tactic: 9895935 Time: 0.0232 [05/21/2021-05:48:55] [V] [TRT] Tactic: 10223615 Time: 0.043044 [05/21/2021-05:48:55] [V] [TRT] Tactic: 10354687 Time: 0.024872 [05/21/2021-05:48:55] [V] [TRT] Tactic: 10551295 Time: 0.029056 [05/21/2021-05:48:55] [V] [TRT] Tactic: 10747903 Time: 0.022528 [05/21/2021-05:48:55] [V] [TRT] Tactic: 10944511 Time: 0.028336 [05/21/2021-05:48:55] [V] [TRT] Fastest Tactic: 4653055 Time: 0.018432 [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:55] [V] [TRT] Tactic: 0 Time: 0.023836 [05/21/2021-05:48:55] [V] [TRT] Tactic: 1 Time: 0.02022 [05/21/2021-05:48:55] [V] [TRT] Tactic: 2 Time: 0.0803 [05/21/2021-05:48:55] [V] [TRT] Tactic: 4 Time: 0.88482 [05/21/2021-05:48:55] [V] [TRT] Tactic: 5 Time: 0.209776 [05/21/2021-05:48:55] [V] [TRT] Tactic: 56 Time: 0.019728 [05/21/2021-05:48:55] [V] [TRT] Tactic: 57 Time: 0.019988 [05/21/2021-05:48:55] [V] [TRT] Tactic: 58 Time: 0.080084 [05/21/2021-05:48:55] [V] [TRT] Tactic: 60 Time: 0.884596 [05/21/2021-05:48:55] [V] [TRT] Tactic: 61 Time: 0.208788 [05/21/2021-05:48:55] [V] [TRT] Tactic: 112 Time: 0.01994 [05/21/2021-05:48:55] [V] [TRT] Tactic: 113 Time: 0.019712 [05/21/2021-05:48:55] [V] [TRT] Tactic: 114 Time: 0.079664 [05/21/2021-05:48:55] [V] [TRT] Tactic: 116 Time: 0.884728 [05/21/2021-05:48:55] [V] [TRT] Tactic: 117 Time: 0.209032 [05/21/2021-05:48:55] [V] [TRT] Fastest Tactic: 113 Time: 0.019712 [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:48:55] [V] [TRT] Tactic: 4549827808004681195 Time: 0.029348 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:48:55] [V] [TRT] Tactic: 5779835512569528575 Time: 0.03586 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:48:55] [V] [TRT] Tactic: 9151672657204310840 Time: 0.040216 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:48:55] [V] [TRT] Tactic: -7491730084094677098 Time: 0.033748 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:48:55] [V] [TRT] Tactic: -6622064180404051845 Time: 0.034816 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:48:55] [V] [TRT] Tactic: -6313876406580483184 Time: 0.040352 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:48:55] [V] [TRT] Tactic: -6273689210331812572 Time: 0.03548 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:48:55] [V] [TRT] Tactic: -4337126844824617177 Time: 0.027728 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:48:55] [V] [TRT] Tactic: -1123676555321336786 Time: 0.03568 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:48:55] [V] [TRT] Tactic: -701551393537224327 Time: 0.030336 [05/21/2021-05:48:55] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.027728 [05/21/2021-05:48:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4653055 [05/21/2021-05:48:55] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:55] [V] [TRT] Tactic: 1663866669559596164 Time: 0.035552 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:55] [V] [TRT] Tactic: 2860655430572478466 Time: 0.02316 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:55] [V] [TRT] Tactic: 4474630279712975759 Time: 0.015596 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:55] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01536 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:55] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0224 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:55] [V] [TRT] Tactic: 5778138195697110003 Time: 0.036352 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:55] [V] [TRT] Tactic: 8918020581761223752 Time: 0.033664 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:55] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02112 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:55] [V] [TRT] Tactic: -4035591156787122265 Time: 0.015732 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:55] [V] [TRT] Tactic: -2809379259463049391 Time: 0.035792 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:55] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033536 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:55] [V] [TRT] Tactic: -504296718212024303 Time: 0.033792 [05/21/2021-05:48:55] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.01536 [05/21/2021-05:48:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:55] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:55] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:48:55] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0273 [05/21/2021-05:48:55] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1663866669559596164 Time: 0.035844 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2860655430572478466 Time: 0.022528 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4474630279712975759 Time: 0.01538 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01536 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4696204239951173149 Time: 0.023196 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:48:56] [V] [TRT] Tactic: 5778138195697110003 Time: 0.036416 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:48:56] [V] [TRT] Tactic: 8918020581761223752 Time: 0.033664 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:48:56] [V] [TRT] Tactic: -7067026478815706014 Time: 0.026752 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:48:56] [V] [TRT] Tactic: -5905193483742532701 Time: 0.021104 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:48:56] [V] [TRT] Tactic: -4035591156787122265 Time: 0.015784 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:48:56] [V] [TRT] Tactic: -2809379259463049391 Time: 0.03594 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:48:56] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033352 [05/21/2021-05:48:56] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:48:56] [V] [TRT] Tactic: -504296718212024303 Time: 0.033736 [05/21/2021-05:48:56] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.01536 [05/21/2021-05:48:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:48:56] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:48:56] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:56] [V] [TRT] Tactic: 0 Time: 0.021812 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1 Time: 0.022292 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2 Time: 0.081824 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4 Time: 0.87814 [05/21/2021-05:48:56] [V] [TRT] Tactic: 5 Time: 0.206444 [05/21/2021-05:48:56] [V] [TRT] Tactic: 56 Time: 0.022004 [05/21/2021-05:48:56] [V] [TRT] Tactic: 58 Time: 0.08178 [05/21/2021-05:48:56] [V] [TRT] Tactic: 60 Time: 0.877228 [05/21/2021-05:48:56] [V] [TRT] Tactic: 61 Time: 0.20454 [05/21/2021-05:48:56] [V] [TRT] Fastest Tactic: 0 Time: 0.021812 [05/21/2021-05:48:56] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:56] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:48:56] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:48:56] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:56] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:48:56] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:48:56] [V] [TRT] Tactic: 589823 Time: 0.034168 [05/21/2021-05:48:56] [V] [TRT] Tactic: 655359 Time: 0.025144 [05/21/2021-05:48:56] [V] [TRT] Tactic: 786431 Time: 0.01472 [05/21/2021-05:48:56] [V] [TRT] Tactic: 851967 Time: 0.015688 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1179647 Time: 0.012492 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1310719 Time: 0.020768 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1376255 Time: 0.02636 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1441791 Time: 0.012776 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1507327 Time: 0.0175 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1638399 Time: 0.014336 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1835007 Time: 0.015068 [05/21/2021-05:48:56] [V] [TRT] Tactic: 1900543 Time: 0.02688 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2097151 Time: 0.013396 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2162687 Time: 0.026628 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2293759 Time: 0.024576 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2359295 Time: 0.01848 [05/21/2021-05:48:56] [V] [TRT] Tactic: 2686975 Time: 0.026148 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3080191 Time: 0.016384 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3342335 Time: 0.018244 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3407871 Time: 0.01702 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3538943 Time: 0.013992 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3670015 Time: 0.044032 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3932159 Time: 0.022608 [05/21/2021-05:48:56] [V] [TRT] Tactic: 3997695 Time: 0.013056 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4063231 Time: 0.01272 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4194303 Time: 0.014312 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4259839 Time: 0.01384 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4325375 Time: 0.013776 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4521983 Time: 0.024576 [05/21/2021-05:48:56] [V] [TRT] Tactic: 4587519 Time: 0.013284 [05/21/2021-05:48:57] [V] [TRT] Tactic: 4653055 Time: 0.012276 [05/21/2021-05:48:57] [V] [TRT] Tactic: 4915199 Time: 0.0133 [05/21/2021-05:48:57] [V] [TRT] Tactic: 4980735 Time: 0.016372 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5177343 Time: 0.014368 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5242879 Time: 0.016084 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5373951 Time: 0.013656 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5439487 Time: 0.015624 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5570559 Time: 0.018052 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5636095 Time: 0.013056 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5701631 Time: 0.02432 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5767167 Time: 0.019736 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5832703 Time: 0.017364 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5898239 Time: 0.01342 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6029311 Time: 0.023176 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6225919 Time: 0.013612 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6291455 Time: 0.013184 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6422527 Time: 0.015796 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6750207 Time: 0.014252 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6815743 Time: 0.017432 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6946815 Time: 0.01554 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7012351 Time: 0.013452 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7077887 Time: 0.01346 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7143423 Time: 0.019048 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7208959 Time: 0.017372 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7340031 Time: 0.012652 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7405567 Time: 0.012324 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7536639 Time: 0.022492 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7602175 Time: 0.014348 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7733247 Time: 0.013616 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7798783 Time: 0.014852 [05/21/2021-05:48:57] [V] [TRT] Tactic: 8191999 Time: 0.017112 [05/21/2021-05:48:57] [V] [TRT] Tactic: 8257535 Time: 0.014444 [05/21/2021-05:48:57] [V] [TRT] Tactic: 8323071 Time: 0.015336 [05/21/2021-05:48:57] [V] [TRT] Tactic: 8650751 Time: 0.0162 [05/21/2021-05:48:57] [V] [TRT] Tactic: 8716287 Time: 0.015084 [05/21/2021-05:48:57] [V] [TRT] Tactic: 9109503 Time: 0.014336 [05/21/2021-05:48:57] [V] [TRT] Tactic: 9568255 Time: 0.013696 [05/21/2021-05:48:57] [V] [TRT] Tactic: 9895935 Time: 0.014704 [05/21/2021-05:48:57] [V] [TRT] Tactic: 10223615 Time: 0.025608 [05/21/2021-05:48:57] [V] [TRT] Tactic: 10354687 Time: 0.01464 [05/21/2021-05:48:57] [V] [TRT] Tactic: 10551295 Time: 0.0191 [05/21/2021-05:48:57] [V] [TRT] Tactic: 10747903 Time: 0.013776 [05/21/2021-05:48:57] [V] [TRT] Tactic: 10944511 Time: 0.01676 [05/21/2021-05:48:57] [V] [TRT] Fastest Tactic: 4653055 Time: 0.012276 [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:57] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:48:57] [V] [TRT] Tactic: 2195670545862694453 Time: 0.018376 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:48:57] [V] [TRT] Tactic: 3891805945559659536 Time: 0.023836 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:48:57] [V] [TRT] Tactic: 4418200634486186714 Time: 0.01728 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:48:57] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018324 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:48:57] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017408 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:48:57] [V] [TRT] Tactic: 7392644644614664811 Time: 0.01732 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:48:57] [V] [TRT] Tactic: -4884039206922900293 Time: 0.023868 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:48:57] [V] [TRT] Tactic: -4374269919094467161 Time: 0.017792 [05/21/2021-05:48:57] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:48:57] [V] [TRT] Tactic: -1546027692247304867 Time: 0.024568 [05/21/2021-05:48:57] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.01728 [05/21/2021-05:48:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4653055 [05/21/2021-05:48:57] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(200704,196,14,1) *************** [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:57] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:48:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:57] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:48:57] [V] [TRT] Tactic: 0 Time: 0.028824 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1 Time: 0.02558 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2 Time: 0.065664 [05/21/2021-05:48:58] [V] [TRT] Tactic: 56 Time: 0.028844 [05/21/2021-05:48:58] [V] [TRT] Tactic: 58 Time: 0.067948 [05/21/2021-05:48:58] [V] [TRT] Fastest Tactic: 1 Time: 0.02558 [05/21/2021-05:48:58] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:48:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:48:58] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:48:58] [V] [TRT] Tactic: 254850674756030979 Time: 0.016936 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01224 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012032 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1576319725282257846 Time: 0.009684 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009216 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1838082074606840426 Time: 0.00936 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:48:58] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008364 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009216 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2541579301352125276 Time: 0.010932 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2559328254295148085 Time: 0.015492 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00896 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:48:58] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009264 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009856 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009348 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3362537467505018070 Time: 0.011312 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3513075359009385578 Time: 0.01662 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3704534001553878387 Time: 0.011264 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:48:58] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007216 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4278315135102886928 Time: 0.008408 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008192 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007936 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01536 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01024 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4571819373777460444 Time: 0.01664 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016816 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4802447371470387646 Time: 0.012288 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:48:58] [V] [TRT] Tactic: 4993757826442493905 Time: 0.008708 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:48:58] [V] [TRT] Tactic: 5059676457552313631 Time: 0.01638 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:48:58] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011228 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:48:58] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0123 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:48:58] [V] [TRT] Tactic: 5398999388616959893 Time: 0.011932 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:48:58] [V] [TRT] Tactic: 6034364043891107501 Time: 0.008064 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:48:58] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01112 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:48:58] [V] [TRT] Tactic: 6468794451065529747 Time: 0.009352 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:48:58] [V] [TRT] Tactic: 6697277555581639516 Time: 0.007268 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:48:58] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008236 [05/21/2021-05:48:58] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:48:59] [V] [TRT] Tactic: 7216571380637776659 Time: 0.012584 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:48:59] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010368 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:48:59] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008776 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:48:59] [V] [TRT] Tactic: 8170606396342855895 Time: 0.009984 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:48:59] [V] [TRT] Tactic: 8764780417487154889 Time: 0.011816 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:48:59] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008956 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:48:59] [V] [TRT] Tactic: 8839784824303350101 Time: 0.011648 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:48:59] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007168 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:48:59] [V] [TRT] Tactic: -9009272790678027912 Time: 0.012288 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:48:59] [V] [TRT] Tactic: -8604374562669615024 Time: 0.007708 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:48:59] [V] [TRT] Tactic: -8280443484414412687 Time: 0.015576 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:48:59] [V] [TRT] Tactic: -8205952393017864204 Time: 0.017024 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:48:59] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009344 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:48:59] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008192 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:48:59] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008216 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:48:59] [V] [TRT] Tactic: -7089118800560870395 Time: 0.007928 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:48:59] [V] [TRT] Tactic: -6768327495007644783 Time: 0.011252 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:48:59] [V] [TRT] Tactic: -6356316196810535311 Time: 0.008376 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:48:59] [V] [TRT] Tactic: -6063766379489217211 Time: 0.008736 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:48:59] [V] [TRT] Tactic: -5530886555766748586 Time: 0.010444 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:48:59] [V] [TRT] Tactic: -5409588854490562130 Time: 0.007188 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:48:59] [V] [TRT] Tactic: -5161596964442251102 Time: 0.008556 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:48:59] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008492 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:48:59] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00768 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:48:59] [V] [TRT] Tactic: -4796511246675321840 Time: 0.009856 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:48:59] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008296 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:48:59] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008728 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:48:59] [V] [TRT] Tactic: -4293222705763522367 Time: 0.007948 [05/21/2021-05:48:59] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:00] [V] [TRT] Tactic: -4152066959007262150 Time: 0.015872 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:00] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008192 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009208 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3905653247016903130 Time: 0.012504 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3903342530518878192 Time: 0.011776 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3864869056275745423 Time: 0.012072 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3601464762214218301 Time: 0.007744 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:00] [V] [TRT] Tactic: -3058330359340425555 Time: 0.008952 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:00] [V] [TRT] Tactic: -2878731503146438856 Time: 0.011648 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:00] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011128 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:00] [V] [TRT] Tactic: -2353603993968373338 Time: 0.011776 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:00] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009216 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:00] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00754 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1985778916402815946 Time: 0.012492 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010112 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009216 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1562548049711204899 Time: 0.011808 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1242202084391243207 Time: 0.00896 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008192 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:00] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009088 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:00] [V] [TRT] Tactic: -406984317033388136 Time: 0.011568 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:00] [V] [TRT] Tactic: -331499326992534460 Time: 0.008488 [05/21/2021-05:49:00] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:49:00] [V] [TRT] Tactic: -206523504474952360 Time: 0.01074 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.007168 [05/21/2021-05:49:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182 [05/21/2021-05:49:00] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.01088 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.010624 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.00718 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00718 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.048068 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.00564 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00564 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.00802 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.00454 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00454 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.006948 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.006936 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.006836 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006836 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.01088 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.006212 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006212 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.00514 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.00514 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:00] [V] [TRT] Tactic: 1002 Time: 0.007372 [05/21/2021-05:49:00] [V] [TRT] Tactic: 0 Time: 0.006224 [05/21/2021-05:49:00] [V] [TRT] Fastest Tactic: 0 Time: 0.006224 [05/21/2021-05:49:00] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.008088 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.007224 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007224 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.00696 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005828 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005828 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007008 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.0059 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0059 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.011324 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.007168 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006784 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006784 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007176 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006784 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006784 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.048544 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007608 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.007008 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007008 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007436 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.007048 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007048 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.010676 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00468 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00468 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.009028 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.009068 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00702 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00702 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.009988 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004488 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004488 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.008064 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00588 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00588 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007752 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006268 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006268 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.013164 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005716 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005716 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006952 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005896 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005896 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.01088 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004252 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004252 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007712 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.004112 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.004112 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.0058 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0058 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.009088 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006996 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006996 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005856 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005856 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005996 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005996 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.01088 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006152 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006152 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.006492 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.006492 [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:01] [V] [TRT] Tactic: 1002 Time: 0.006184 [05/21/2021-05:49:01] [V] [TRT] Tactic: 0 Time: 0.005232 [05/21/2021-05:49:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005232 [05/21/2021-05:49:01] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudaDepthwiseConvolution) [05/21/2021-05:49:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (FusedConvActConvolution) [05/21/2021-05:49:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:01] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:02] [V] [TRT] Tactic: 0 Time: 0.04276 [05/21/2021-05:49:02] [V] [TRT] Tactic: 1 Time: 0.037984 [05/21/2021-05:49:02] [V] [TRT] Tactic: 2 Time: 0.140416 [05/21/2021-05:49:02] [V] [TRT] Tactic: 56 Time: 0.042756 [05/21/2021-05:49:02] [V] [TRT] Tactic: 57 Time: 0.037724 [05/21/2021-05:49:02] [V] [TRT] Tactic: 58 Time: 0.139904 [05/21/2021-05:49:02] [V] [TRT] Tactic: 112 Time: 0.04224 [05/21/2021-05:49:02] [V] [TRT] Tactic: 113 Time: 0.03762 [05/21/2021-05:49:02] [V] [TRT] Tactic: 114 Time: 0.139556 [05/21/2021-05:49:02] [V] [TRT] Fastest Tactic: 113 Time: 0.03762 [05/21/2021-05:49:02] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4549827808004681195 Time: 0.055216 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:02] [V] [TRT] Tactic: 5779835512569528575 Time: 0.078 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:02] [V] [TRT] Tactic: 9151672657204310840 Time: 0.072432 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:02] [V] [TRT] Tactic: -7491730084094677098 Time: 0.085324 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:02] [V] [TRT] Tactic: -6313876406580483184 Time: 0.068764 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:02] [V] [TRT] Tactic: -6273689210331812572 Time: 0.067548 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:02] [V] [TRT] Tactic: -4337126844824617177 Time: 0.046208 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:02] [V] [TRT] Tactic: -1123676555321336786 Time: 0.077312 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:02] [V] [TRT] Tactic: -701551393537224327 Time: 0.05738 [05/21/2021-05:49:02] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.046208 [05/21/2021-05:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 113 [05/21/2021-05:49:02] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:02] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:02] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:02] [V] [TRT] Tactic: 1663866669559596164 Time: 0.068112 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:02] [V] [TRT] Tactic: 2860655430572478466 Time: 0.041596 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4474630279712975759 Time: 0.027648 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4479823862704990365 Time: 0.027312 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4696204239951173149 Time: 0.040836 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:02] [V] [TRT] Tactic: 5778138195697110003 Time: 0.069116 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:02] [V] [TRT] Tactic: 8918020581761223752 Time: 0.05956 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:02] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034696 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:02] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023828 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:02] [V] [TRT] Tactic: -2809379259463049391 Time: 0.069008 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:02] [V] [TRT] Tactic: -1985235291706575900 Time: 0.06302 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:02] [V] [TRT] Tactic: -504296718212024303 Time: 0.0633 [05/21/2021-05:49:02] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023828 [05/21/2021-05:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:02] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:02] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:02] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:02] [V] [TRT] Tactic: 1373022415249282411 Time: 0.045568 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:02] [V] [TRT] Tactic: 1663866669559596164 Time: 0.068452 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:02] [V] [TRT] Tactic: 2860655430572478466 Time: 0.041644 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02742 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4479823862704990365 Time: 0.027056 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:02] [V] [TRT] Tactic: 4696204239951173149 Time: 0.040832 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:02] [V] [TRT] Tactic: 5778138195697110003 Time: 0.064828 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:49:02] [V] [TRT] Tactic: 7342025736444949634 Time: 0.043376 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:02] [V] [TRT] Tactic: 8918020581761223752 Time: 0.05912 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:02] [V] [TRT] Tactic: -5905193483742532701 Time: 0.038036 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:49:02] [V] [TRT] Tactic: -5457304872213719461 Time: 0.047152 [05/21/2021-05:49:02] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:03] [V] [TRT] Tactic: -4035591156787122265 Time: 0.026752 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:03] [V] [TRT] Tactic: -2809379259463049391 Time: 0.068364 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:03] [V] [TRT] Tactic: -1985235291706575900 Time: 0.062876 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:03] [V] [TRT] Tactic: -504296718212024303 Time: 0.063324 [05/21/2021-05:49:03] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.026752 [05/21/2021-05:49:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:03] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:03] [V] [TRT] Tactic: 0 Time: 0.038924 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1 Time: 0.039836 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2 Time: 0.101632 [05/21/2021-05:49:03] [V] [TRT] Tactic: 56 Time: 0.0392 [05/21/2021-05:49:03] [V] [TRT] Tactic: 58 Time: 0.094288 [05/21/2021-05:49:03] [V] [TRT] Fastest Tactic: 0 Time: 0.038924 [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:49:03] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (FusedConvActConvolution) [05/21/2021-05:49:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:03] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2195670545862694453 Time: 0.032776 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:03] [V] [TRT] Tactic: 3891805945559659536 Time: 0.042352 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:03] [V] [TRT] Tactic: 4418200634486186714 Time: 0.02718 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:03] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029512 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:03] [V] [TRT] Tactic: 6057304366605292508 Time: 0.028544 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:03] [V] [TRT] Tactic: 7392644644614664811 Time: 0.028028 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:03] [V] [TRT] Tactic: -4884039206922900293 Time: 0.042296 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:03] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028928 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:03] [V] [TRT] Tactic: -1546027692247304867 Time: 0.041984 [05/21/2021-05:49:03] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.02718 [05/21/2021-05:49:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:49:03] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:03] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudaDepthwiseConvolution) [05/21/2021-05:49:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:03] [V] [TRT] Tactic: 0 Time: 0.057088 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1 Time: 0.051612 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2 Time: 0.089336 [05/21/2021-05:49:03] [V] [TRT] Tactic: 56 Time: 0.055792 [05/21/2021-05:49:03] [V] [TRT] Tactic: 58 Time: 0.088612 [05/21/2021-05:49:03] [V] [TRT] Fastest Tactic: 1 Time: 0.051612 [05/21/2021-05:49:03] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:03] [V] [TRT] Tactic: 254850674756030979 Time: 0.02624 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1011057357468998345 Time: 0.017408 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1156328698016730421 Time: 0.018048 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1362727228442059924 Time: 0.018168 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011628 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011604 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011264 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:03] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009744 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2238656696610018305 Time: 0.01204 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2428167804343994714 Time: 0.011608 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2541579301352125276 Time: 0.016988 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:49:03] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025668 [05/21/2021-05:49:03] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:04] [V] [TRT] Tactic: 2657157263811141609 Time: 0.010752 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:04] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0126 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:49:04] [V] [TRT] Tactic: 3071479995783211391 Time: 0.013488 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:49:04] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010288 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:04] [V] [TRT] Tactic: 3362537467505018070 Time: 0.016384 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:04] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0267 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:04] [V] [TRT] Tactic: 3704534001553878387 Time: 0.01728 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:04] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011684 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:49:04] [V] [TRT] Tactic: 4480294673430783793 Time: 0.011448 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:49:04] [V] [TRT] Tactic: 4571819373777460444 Time: 0.02624 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:04] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01784 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:04] [V] [TRT] Tactic: 5059676457552313631 Time: 0.02578 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:49:04] [V] [TRT] Tactic: 5205510332404400949 Time: 0.015744 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:49:04] [V] [TRT] Tactic: 5346855796032465921 Time: 0.015384 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:49:04] [V] [TRT] Tactic: 5368829646735632944 Time: 0.008192 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:04] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0173 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6034364043891107501 Time: 0.011264 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6154447660803990543 Time: 0.011952 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6325769668000961702 Time: 0.017664 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6350273239113254096 Time: 0.01408 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6377497238381488891 Time: 0.016932 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6468794451065529747 Time: 0.012928 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009684 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:49:04] [V] [TRT] Tactic: 6979044990896381511 Time: 0.024704 [05/21/2021-05:49:04] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:05] [V] [TRT] Tactic: 7216571380637776659 Time: 0.01842 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:05] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011776 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:49:05] [V] [TRT] Tactic: 8072087735545283117 Time: 0.025728 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:05] [V] [TRT] Tactic: 8101703987960976805 Time: 0.010496 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:05] [V] [TRT] Tactic: 8170606396342855895 Time: 0.012408 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:49:05] [V] [TRT] Tactic: 8764780417487154889 Time: 0.01718 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:05] [V] [TRT] Tactic: 8839784824303350101 Time: 0.018176 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:05] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018736 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8985224497679592364 Time: 0.010356 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8759929675070720385 Time: 0.01536 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009428 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8280443484414412687 Time: 0.024832 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8205952393017864204 Time: 0.023936 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:49:05] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011816 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:49:05] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0103 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:49:05] [V] [TRT] Tactic: -7099920365135295801 Time: 0.01084 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:49:05] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009784 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:49:05] [V] [TRT] Tactic: -6799856376604253964 Time: 0.026008 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:49:05] [V] [TRT] Tactic: -6525498856028268801 Time: 0.01652 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:05] [V] [TRT] Tactic: -6356316196810535311 Time: 0.010872 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:49:05] [V] [TRT] Tactic: -6324345858751792783 Time: 0.012136 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:05] [V] [TRT] Tactic: -6063766379489217211 Time: 0.012284 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5777580938094193096 Time: 0.010752 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5657273398217409378 Time: 0.024576 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016372 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00924 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011268 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:05] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010824 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009576 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4825567853927730435 Time: 0.011676 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01244 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4548822885169694805 Time: 0.010248 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011756 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4293222705763522367 Time: 0.009628 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4152066959007262150 Time: 0.026648 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:05] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011376 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:05] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011952 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:05] [V] [TRT] Tactic: -3905653247016903130 Time: 0.017164 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:49:05] [V] [TRT] Tactic: -3903974568488493144 Time: 0.010752 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:05] [V] [TRT] Tactic: -3903342530518878192 Time: 0.017152 [05/21/2021-05:49:05] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:06] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01754 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:06] [V] [TRT] Tactic: -3601464762214218301 Time: 0.009856 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:49:06] [V] [TRT] Tactic: -3338665856053412950 Time: 0.017024 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:06] [V] [TRT] Tactic: -3058330359340425555 Time: 0.012032 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2878731503146438856 Time: 0.01666 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2662892962457732243 Time: 0.011232 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2602982885923184927 Time: 0.016424 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2530740716768816092 Time: 0.015776 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2353603993968373338 Time: 0.017144 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2332828394978346992 Time: 0.015404 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2161909437867201546 Time: 0.012508 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2032577876140256150 Time: 0.012112 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:06] [V] [TRT] Tactic: -2003055242756584050 Time: 0.01096 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1985778916402815946 Time: 0.018276 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1640527254204634147 Time: 0.012192 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1562548049711204899 Time: 0.01664 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1242202084391243207 Time: 0.011524 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1099247066487349374 Time: 0.010224 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:06] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011812 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:49:06] [V] [TRT] Tactic: -910286698936744682 Time: 0.009856 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:49:06] [V] [TRT] Tactic: -606726295133751039 Time: 0.009344 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:06] [V] [TRT] Tactic: -406984317033388136 Time: 0.016372 [05/21/2021-05:49:06] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:06] [V] [TRT] Tactic: -331499326992534460 Time: 0.010764 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 5368829646735632944 Time: 0.008192 [05/21/2021-05:49:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5368829646735632944 [05/21/2021-05:49:06] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution) [05/21/2021-05:49:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution) [05/21/2021-05:49:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.010776 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.007204 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.007204 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.010576 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.007224 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.007224 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.047828 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.00574 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00574 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.007996 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.004556 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004556 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.006936 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.006824 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006824 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.011032 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.006828 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006828 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.00942 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.006784 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006784 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.007548 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.006572 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006572 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.006132 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.0051 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0051 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.006132 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.005108 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005108 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.010184 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.007428 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.007428 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.009344 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.005136 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005136 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:06] [V] [TRT] Tactic: 1002 Time: 0.00786 [05/21/2021-05:49:06] [V] [TRT] Tactic: 0 Time: 0.006796 [05/21/2021-05:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006796 [05/21/2021-05:49:06] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00708 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00708 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.00668 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005484 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005484 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.006712 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005844 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005844 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.047616 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005136 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005136 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00664 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00664 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.007164 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.007164 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.010748 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.00896 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004376 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004376 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.008832 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006888 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006888 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004272 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004272 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007176 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00524 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00524 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.0087 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006244 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006244 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.013172 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007724 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005896 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005896 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.009084 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004524 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004524 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00554 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00554 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007008 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005764 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005764 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.010904 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00396 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00396 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(12544,1:16,896,64) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005164 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005164 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.008332 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00632 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00632 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,1,14336,1024) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(50176,1:4,3584,256) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006016 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(200704,196,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.01098 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006744 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006744 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(100352,196:2,14,1) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.007784 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006912 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006912 [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(25088,1:8,1792,128) (Reformat) [05/21/2021-05:49:07] [V] [TRT] Tactic: 1002 Time: 0.006844 [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005976 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005976 [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005132 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005132 [05/21/2021-05:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.005068 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005068 [05/21/2021-05:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Tactic: 0 Time: 0.006128 [05/21/2021-05:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.006128 [05/21/2021-05:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale) [05/21/2021-05:49:07] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:07] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:49:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:49:07] [V] [TRT] Tactic: 589823 Time: 0.211968 [05/21/2021-05:49:07] [V] [TRT] Tactic: 655359 Time: 0.1344 [05/21/2021-05:49:07] [V] [TRT] Tactic: 786431 Time: 0.047104 [05/21/2021-05:49:07] [V] [TRT] Tactic: 851967 Time: 0.04096 [05/21/2021-05:49:07] [V] [TRT] Tactic: 1179647 Time: 0.027008 [05/21/2021-05:49:07] [V] [TRT] Tactic: 1310719 Time: 0.091576 [05/21/2021-05:49:07] [V] [TRT] Tactic: 1376255 Time: 0.142992 [05/21/2021-05:49:07] [V] [TRT] Tactic: 1441791 Time: 0.030948 [05/21/2021-05:49:08] [V] [TRT] Tactic: 1507327 Time: 0.075264 [05/21/2021-05:49:08] [V] [TRT] Tactic: 1638399 Time: 0.032384 [05/21/2021-05:49:08] [V] [TRT] Tactic: 1835007 Time: 0.053656 [05/21/2021-05:49:08] [V] [TRT] Tactic: 1900543 Time: 0.14498 [05/21/2021-05:49:08] [V] [TRT] Tactic: 2097151 Time: 0.019712 [05/21/2021-05:49:08] [V] [TRT] Tactic: 2162687 Time: 0.145712 [05/21/2021-05:49:08] [V] [TRT] Tactic: 2293759 Time: 0.131328 [05/21/2021-05:49:08] [V] [TRT] Tactic: 2359295 Time: 0.07792 [05/21/2021-05:49:08] [V] [TRT] Tactic: 2686975 Time: 0.135044 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3080191 Time: 0.067456 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3342335 Time: 0.074752 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3407871 Time: 0.067668 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3538943 Time: 0.038184 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3670015 Time: 0.260992 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3932159 Time: 0.113792 [05/21/2021-05:49:08] [V] [TRT] Tactic: 3997695 Time: 0.028832 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4063231 Time: 0.04252 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4194303 Time: 0.05266 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4259839 Time: 0.02104 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4325375 Time: 0.038784 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4521983 Time: 0.131584 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4587519 Time: 0.028884 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4653055 Time: 0.028452 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4915199 Time: 0.029152 [05/21/2021-05:49:08] [V] [TRT] Tactic: 4980735 Time: 0.069248 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5177343 Time: 0.026796 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5242879 Time: 0.064384 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5373951 Time: 0.02752 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5439487 Time: 0.04736 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5570559 Time: 0.07374 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5636095 Time: 0.042164 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5701631 Time: 0.125184 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5767167 Time: 0.071952 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5832703 Time: 0.069632 [05/21/2021-05:49:08] [V] [TRT] Tactic: 5898239 Time: 0.02944 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6029311 Time: 0.121816 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6225919 Time: 0.038276 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6291455 Time: 0.026732 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6422527 Time: 0.064128 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6750207 Time: 0.028152 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6815743 Time: 0.068888 [05/21/2021-05:49:08] [V] [TRT] Tactic: 6946815 Time: 0.045744 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7012351 Time: 0.019584 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7077887 Time: 0.039808 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7143423 Time: 0.070444 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7208959 Time: 0.070164 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7340031 Time: 0.030568 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7405567 Time: 0.035328 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7536639 Time: 0.112736 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7602175 Time: 0.04506 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7733247 Time: 0.043008 [05/21/2021-05:49:08] [V] [TRT] Tactic: 7798783 Time: 0.047104 [05/21/2021-05:49:08] [V] [TRT] Tactic: 8191999 Time: 0.040988 [05/21/2021-05:49:08] [V] [TRT] Tactic: 8257535 Time: 0.029492 [05/21/2021-05:49:08] [V] [TRT] Tactic: 8323071 Time: 0.045056 [05/21/2021-05:49:08] [V] [TRT] Tactic: 8650751 Time: 0.045096 [05/21/2021-05:49:09] [V] [TRT] Tactic: 8716287 Time: 0.040576 [05/21/2021-05:49:09] [V] [TRT] Tactic: 9109503 Time: 0.02048 [05/21/2021-05:49:09] [V] [TRT] Tactic: 9568255 Time: 0.029312 [05/21/2021-05:49:09] [V] [TRT] Tactic: 9895935 Time: 0.05188 [05/21/2021-05:49:09] [V] [TRT] Tactic: 10223615 Time: 0.13568 [05/21/2021-05:49:09] [V] [TRT] Tactic: 10354687 Time: 0.03072 [05/21/2021-05:49:09] [V] [TRT] Tactic: 10551295 Time: 0.074292 [05/21/2021-05:49:09] [V] [TRT] Tactic: 10747903 Time: 0.04214 [05/21/2021-05:49:09] [V] [TRT] Tactic: 10944511 Time: 0.070016 [05/21/2021-05:49:09] [V] [TRT] Fastest Tactic: 7012351 Time: 0.019584 [05/21/2021-05:49:09] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:09] [V] [TRT] Tactic: 0 Time: 0.056896 [05/21/2021-05:49:09] [V] [TRT] Tactic: 1 Time: 0.044896 [05/21/2021-05:49:09] [V] [TRT] Tactic: 2 Time: 0.135552 [05/21/2021-05:49:09] [V] [TRT] Tactic: 4 Time: 0.886084 [05/21/2021-05:49:09] [V] [TRT] Tactic: 5 Time: 0.207676 [05/21/2021-05:49:09] [V] [TRT] Tactic: 56 Time: 0.04978 [05/21/2021-05:49:09] [V] [TRT] Tactic: 57 Time: 0.042624 [05/21/2021-05:49:09] [V] [TRT] Tactic: 58 Time: 0.101376 [05/21/2021-05:49:09] [V] [TRT] Tactic: 60 Time: 0.887656 [05/21/2021-05:49:09] [V] [TRT] Tactic: 61 Time: 0.209412 [05/21/2021-05:49:09] [V] [TRT] Tactic: 112 Time: 0.054272 [05/21/2021-05:49:09] [V] [TRT] Tactic: 113 Time: 0.043456 [05/21/2021-05:49:09] [V] [TRT] Tactic: 114 Time: 0.135672 [05/21/2021-05:49:09] [V] [TRT] Tactic: 116 Time: 0.886496 [05/21/2021-05:49:09] [V] [TRT] Tactic: 117 Time: 0.208996 [05/21/2021-05:49:09] [V] [TRT] Fastest Tactic: 57 Time: 0.042624 [05/21/2021-05:49:09] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:09] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:09] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:09] [V] [TRT] Tactic: 4549827808004681195 Time: 0.090808 [05/21/2021-05:49:09] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:10] [V] [TRT] Tactic: 5779835512569528575 Time: 0.115632 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:10] [V] [TRT] Tactic: 9151672657204310840 Time: 0.097828 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:10] [V] [TRT] Tactic: -7491730084094677098 Time: 0.114932 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:49:10] [V] [TRT] Tactic: -6622064180404051845 Time: 0.090496 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:10] [V] [TRT] Tactic: -6313876406580483184 Time: 0.155092 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:10] [V] [TRT] Tactic: -6273689210331812572 Time: 0.114832 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:10] [V] [TRT] Tactic: -4337126844824617177 Time: 0.084052 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:10] [V] [TRT] Tactic: -1123676555321336786 Time: 0.114624 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:10] [V] [TRT] Tactic: -701551393537224327 Time: 0.094592 [05/21/2021-05:49:10] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.084052 [05/21/2021-05:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351 [05/21/2021-05:49:10] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:10] [V] [TRT] Tactic: 1663866669559596164 Time: 0.119812 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:10] [V] [TRT] Tactic: 2860655430572478466 Time: 0.06954 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4474630279712975759 Time: 0.039552 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4479823862704990365 Time: 0.038912 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4696204239951173149 Time: 0.069884 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:10] [V] [TRT] Tactic: 5778138195697110003 Time: 0.120924 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:10] [V] [TRT] Tactic: 8918020581761223752 Time: 0.111904 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:10] [V] [TRT] Tactic: -5905193483742532701 Time: 0.061408 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:10] [V] [TRT] Tactic: -4035591156787122265 Time: 0.038904 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:10] [V] [TRT] Tactic: -2809379259463049391 Time: 0.120168 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:10] [V] [TRT] Tactic: -1985235291706575900 Time: 0.110336 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:10] [V] [TRT] Tactic: -504296718212024303 Time: 0.111964 [05/21/2021-05:49:10] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.038904 [05/21/2021-05:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:10] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:10] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:10] [V] [TRT] Tactic: 1373022415249282411 Time: 0.079744 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:10] [V] [TRT] Tactic: 1663866669559596164 Time: 0.120448 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:10] [V] [TRT] Tactic: 2860655430572478466 Time: 0.069108 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4474630279712975759 Time: 0.039808 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4479823862704990365 Time: 0.04018 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:10] [V] [TRT] Tactic: 4696204239951173149 Time: 0.069492 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:10] [V] [TRT] Tactic: 5778138195697110003 Time: 0.121576 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:10] [V] [TRT] Tactic: 8918020581761223752 Time: 0.109956 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:49:10] [V] [TRT] Tactic: -7067026478815706014 Time: 0.079348 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:10] [V] [TRT] Tactic: -5905193483742532701 Time: 0.06138 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:10] [V] [TRT] Tactic: -4035591156787122265 Time: 0.03904 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:10] [V] [TRT] Tactic: -2809379259463049391 Time: 0.120064 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:10] [V] [TRT] Tactic: -1985235291706575900 Time: 0.109556 [05/21/2021-05:49:10] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:10] [V] [TRT] Tactic: -504296718212024303 Time: 0.110636 [05/21/2021-05:49:11] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.03904 [05/21/2021-05:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:11] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:11] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:11] [V] [TRT] Tactic: 0 Time: 0.056452 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1 Time: 0.053632 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2 Time: 0.106496 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4 Time: 0.879288 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5 Time: 0.206904 [05/21/2021-05:49:11] [V] [TRT] Tactic: 56 Time: 0.056588 [05/21/2021-05:49:11] [V] [TRT] Tactic: 58 Time: 0.107092 [05/21/2021-05:49:11] [V] [TRT] Tactic: 60 Time: 0.878824 [05/21/2021-05:49:11] [V] [TRT] Tactic: 61 Time: 0.206924 [05/21/2021-05:49:11] [V] [TRT] Fastest Tactic: 1 Time: 0.053632 [05/21/2021-05:49:11] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:11] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:49:11] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:11] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:11] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:11] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:49:11] [V] [TRT] Tactic: 589823 Time: 0.110928 [05/21/2021-05:49:11] [V] [TRT] Tactic: 655359 Time: 0.079536 [05/21/2021-05:49:11] [V] [TRT] Tactic: 786431 Time: 0.029432 [05/21/2021-05:49:11] [V] [TRT] Tactic: 851967 Time: 0.025216 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1179647 Time: 0.01654 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1310719 Time: 0.055808 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1376255 Time: 0.082816 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1441791 Time: 0.018944 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1507327 Time: 0.045056 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1638399 Time: 0.018764 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1835007 Time: 0.028064 [05/21/2021-05:49:11] [V] [TRT] Tactic: 1900543 Time: 0.086196 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2097151 Time: 0.01368 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2162687 Time: 0.08512 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2293759 Time: 0.073728 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2359295 Time: 0.046324 [05/21/2021-05:49:11] [V] [TRT] Tactic: 2686975 Time: 0.07548 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3080191 Time: 0.039944 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3342335 Time: 0.045564 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3407871 Time: 0.039056 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3538943 Time: 0.02306 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3670015 Time: 0.153876 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3932159 Time: 0.064024 [05/21/2021-05:49:11] [V] [TRT] Tactic: 3997695 Time: 0.018804 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4063231 Time: 0.024576 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4194303 Time: 0.027648 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4259839 Time: 0.013556 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4325375 Time: 0.021504 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4521983 Time: 0.074624 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4587519 Time: 0.016768 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4653055 Time: 0.018432 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4915199 Time: 0.018484 [05/21/2021-05:49:11] [V] [TRT] Tactic: 4980735 Time: 0.038036 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5177343 Time: 0.017152 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5242879 Time: 0.0369 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5373951 Time: 0.017436 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5439487 Time: 0.027008 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5570559 Time: 0.044292 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5636095 Time: 0.024744 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5701631 Time: 0.071024 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5767167 Time: 0.04104 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5832703 Time: 0.04096 [05/21/2021-05:49:11] [V] [TRT] Tactic: 5898239 Time: 0.019972 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6029311 Time: 0.068108 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6225919 Time: 0.021476 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6291455 Time: 0.016884 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6422527 Time: 0.036168 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6750207 Time: 0.018708 [05/21/2021-05:49:11] [V] [TRT] Tactic: 6815743 Time: 0.040488 [05/21/2021-05:49:12] [V] [TRT] Tactic: 6946815 Time: 0.028852 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7012351 Time: 0.01332 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7077887 Time: 0.022592 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7143423 Time: 0.039152 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7208959 Time: 0.04096 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7340031 Time: 0.020096 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7405567 Time: 0.022272 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7536639 Time: 0.06156 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7602175 Time: 0.027636 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7733247 Time: 0.026496 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7798783 Time: 0.029356 [05/21/2021-05:49:12] [V] [TRT] Tactic: 8191999 Time: 0.02374 [05/21/2021-05:49:12] [V] [TRT] Tactic: 8257535 Time: 0.018436 [05/21/2021-05:49:12] [V] [TRT] Tactic: 8323071 Time: 0.02632 [05/21/2021-05:49:12] [V] [TRT] Tactic: 8650751 Time: 0.02814 [05/21/2021-05:49:12] [V] [TRT] Tactic: 8716287 Time: 0.023296 [05/21/2021-05:49:12] [V] [TRT] Tactic: 9109503 Time: 0.01378 [05/21/2021-05:49:12] [V] [TRT] Tactic: 9568255 Time: 0.018036 [05/21/2021-05:49:12] [V] [TRT] Tactic: 9895935 Time: 0.02816 [05/21/2021-05:49:12] [V] [TRT] Tactic: 10223615 Time: 0.075632 [05/21/2021-05:49:12] [V] [TRT] Tactic: 10354687 Time: 0.0161 [05/21/2021-05:49:12] [V] [TRT] Tactic: 10551295 Time: 0.043404 [05/21/2021-05:49:12] [V] [TRT] Tactic: 10747903 Time: 0.0256 [05/21/2021-05:49:12] [V] [TRT] Tactic: 10944511 Time: 0.037888 [05/21/2021-05:49:12] [V] [TRT] Fastest Tactic: 7012351 Time: 0.01332 [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:12] [V] [TRT] Tactic: 2195670545862694453 Time: 0.053376 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:12] [V] [TRT] Tactic: 3891805945559659536 Time: 0.076424 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:12] [V] [TRT] Tactic: 4418200634486186714 Time: 0.045268 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:12] [V] [TRT] Tactic: 5548126322150286555 Time: 0.050512 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:12] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048168 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:12] [V] [TRT] Tactic: 7392644644614664811 Time: 0.046652 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:12] [V] [TRT] Tactic: -4884039206922900293 Time: 0.074752 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:12] [V] [TRT] Tactic: -4374269919094467161 Time: 0.04832 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:12] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0758 [05/21/2021-05:49:12] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.045268 [05/21/2021-05:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351 [05/21/2021-05:49:12] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:12] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:49:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:12] [V] [TRT] Tactic: 0 Time: 0.067584 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1 Time: 0.078848 [05/21/2021-05:49:12] [V] [TRT] Tactic: 2 Time: 0.091528 [05/21/2021-05:49:12] [V] [TRT] Tactic: 56 Time: 0.069744 [05/21/2021-05:49:12] [V] [TRT] Tactic: 58 Time: 0.093348 [05/21/2021-05:49:12] [V] [TRT] Fastest Tactic: 0 Time: 0.067584 [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:12] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:12] [V] [TRT] Tactic: 254850674756030979 Time: 0.042168 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1156328698016730421 Time: 0.026544 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1362727228442059924 Time: 0.027336 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1576319725282257846 Time: 0.015516 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01548 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1838082074606840426 Time: 0.015616 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:12] [V] [TRT] Tactic: 1899296423087490472 Time: 0.01024 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:12] [V] [TRT] Tactic: 2238656696610018305 Time: 0.015204 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:12] [V] [TRT] Tactic: 2541579301352125276 Time: 0.024576 [05/21/2021-05:49:12] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:49:13] [V] [TRT] Tactic: 2559328254295148085 Time: 0.042868 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:13] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011228 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:13] [V] [TRT] Tactic: 2968605903460894194 Time: 0.015416 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3071479995783211391 Time: 0.008616 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3359475309458902373 Time: 0.015104 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3362537467505018070 Time: 0.024064 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3513075359009385578 Time: 0.043008 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3704534001553878387 Time: 0.02518 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:49:13] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009336 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4278315135102886928 Time: 0.014336 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0142 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4480294673430783793 Time: 0.013972 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4491683531415781597 Time: 0.041888 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4528997467275241200 Time: 0.023792 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4571819373777460444 Time: 0.042616 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4595173549602041350 Time: 0.041432 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4802447371470387646 Time: 0.026032 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:49:13] [V] [TRT] Tactic: 4993757826442493905 Time: 0.014564 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:13] [V] [TRT] Tactic: 5059676457552313631 Time: 0.041844 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:49:13] [V] [TRT] Tactic: 5205510332404400949 Time: 0.024364 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:49:13] [V] [TRT] Tactic: 5346855796032465921 Time: 0.023532 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:13] [V] [TRT] Tactic: 5398999388616959893 Time: 0.02496 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:13] [V] [TRT] Tactic: 6034364043891107501 Time: 0.014336 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:13] [V] [TRT] Tactic: 6377497238381488891 Time: 0.024832 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:13] [V] [TRT] Tactic: 6468794451065529747 Time: 0.015872 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:49:13] [V] [TRT] Tactic: 6697277555581639516 Time: 0.014392 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:13] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010568 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:13] [V] [TRT] Tactic: 7216571380637776659 Time: 0.029072 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:13] [V] [TRT] Tactic: 7609923741161019135 Time: 0.015096 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:13] [V] [TRT] Tactic: 8101703987960976805 Time: 0.011248 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:13] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01582 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:49:13] [V] [TRT] Tactic: 8764780417487154889 Time: 0.025216 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:49:13] [V] [TRT] Tactic: 8823554289762712606 Time: 0.014892 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:13] [V] [TRT] Tactic: 8839784824303350101 Time: 0.026756 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:49:13] [V] [TRT] Tactic: -9203179519031456182 Time: 0.010468 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:13] [V] [TRT] Tactic: -9009272790678027912 Time: 0.027636 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:13] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011304 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:49:13] [V] [TRT] Tactic: -8280443484414412687 Time: 0.041848 [05/21/2021-05:49:13] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:49:14] [V] [TRT] Tactic: -8205952393017864204 Time: 0.04126 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:49:14] [V] [TRT] Tactic: -8131857373260504832 Time: 0.015344 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:49:14] [V] [TRT] Tactic: -7410012245391920273 Time: 0.011264 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:49:14] [V] [TRT] Tactic: -7099920365135295801 Time: 0.015212 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:49:14] [V] [TRT] Tactic: -7089118800560870395 Time: 0.010752 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:49:14] [V] [TRT] Tactic: -6768327495007644783 Time: 0.022572 [05/21/2021-05:49:14] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:15] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012188 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:15] [V] [TRT] Tactic: -6063766379489217211 Time: 0.015684 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:15] [V] [TRT] Tactic: -5530886555766748586 Time: 0.02476 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:49:15] [V] [TRT] Tactic: -5409588854490562130 Time: 0.011148 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:15] [V] [TRT] Tactic: -5161596964442251102 Time: 0.015344 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:15] [V] [TRT] Tactic: -5127240325355316006 Time: 0.014336 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009472 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4796511246675321840 Time: 0.016256 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4548822885169694805 Time: 0.01092 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4379519430184503304 Time: 0.014848 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4293222705763522367 Time: 0.010368 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4152066959007262150 Time: 0.042656 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:15] [V] [TRT] Tactic: -4021926646879732549 Time: 0.015028 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3987638434926559037 Time: 0.015488 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3905653247016903130 Time: 0.025984 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3903342530518878192 Time: 0.024832 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3864869056275745423 Time: 0.024704 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010364 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:15] [V] [TRT] Tactic: -3058330359340425555 Time: 0.015872 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:15] [V] [TRT] Tactic: -2878731503146438856 Time: 0.024548 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:15] [V] [TRT] Tactic: -2602982885923184927 Time: 0.023748 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:15] [V] [TRT] Tactic: -2353603993968373338 Time: 0.025984 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:15] [V] [TRT] Tactic: -2032577876140256150 Time: 0.015568 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:15] [V] [TRT] Tactic: -2003055242756584050 Time: 0.014336 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1985778916402815946 Time: 0.026624 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1828674067637788567 Time: 0.008688 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1640527254204634147 Time: 0.01464 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1562548049711204899 Time: 0.022884 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1242202084391243207 Time: 0.01454 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1099247066487349374 Time: 0.010464 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:15] [V] [TRT] Tactic: -1038291877007553549 Time: 0.015616 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:15] [V] [TRT] Tactic: -406984317033388136 Time: 0.024664 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:15] [V] [TRT] Tactic: -331499326992534460 Time: 0.014472 [05/21/2021-05:49:15] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:49:15] [V] [TRT] Tactic: -206523504474952360 Time: 0.024292 [05/21/2021-05:49:15] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.008616 [05/21/2021-05:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391 [05/21/2021-05:49:15] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:15] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution) [05/21/2021-05:49:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:15] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution) [05/21/2021-05:49:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:16] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution) [05/21/2021-05:49:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:16] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:16] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:49:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:16] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:49:16] [V] [TRT] Tactic: 524287 Time: 0.106112 [05/21/2021-05:49:16] [V] [TRT] Tactic: 720895 Time: 0.085824 [05/21/2021-05:49:16] [V] [TRT] Tactic: 983039 Time: 0.04212 [05/21/2021-05:49:16] [V] [TRT] Tactic: 1048575 Time: 0.06962 [05/21/2021-05:49:16] [V] [TRT] Tactic: 1703935 Time: 0.038144 [05/21/2021-05:49:16] [V] [TRT] Tactic: 1769471 Time: 0.040968 [05/21/2021-05:49:16] [V] [TRT] Tactic: 1966079 Time: 0.17408 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2031615 Time: 0.138368 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2228223 Time: 0.075692 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2424831 Time: 0.032276 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2621439 Time: 0.031704 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2752511 Time: 0.092288 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2818047 Time: 0.088412 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2883583 Time: 0.205116 [05/21/2021-05:49:16] [V] [TRT] Tactic: 3014655 Time: 0.044076 [05/21/2021-05:49:16] [V] [TRT] Tactic: 3145727 Time: 0.04876 [05/21/2021-05:49:16] [V] [TRT] Tactic: 3473407 Time: 0.109828 [05/21/2021-05:49:16] [V] [TRT] Tactic: 3604479 Time: 0.044816 [05/21/2021-05:49:16] [V] [TRT] Tactic: 3735551 Time: 0.08748 [05/21/2021-05:49:16] [V] [TRT] Tactic: 4390911 Time: 0.18738 [05/21/2021-05:49:16] [V] [TRT] Tactic: 5046271 Time: 0.063744 [05/21/2021-05:49:16] [V] [TRT] Tactic: 5963775 Time: 0.149804 [05/21/2021-05:49:16] [V] [TRT] Tactic: 6160383 Time: 0.088604 [05/21/2021-05:49:16] [V] [TRT] Tactic: 6488063 Time: 0.075776 [05/21/2021-05:49:16] [V] [TRT] Tactic: 6881279 Time: 0.123904 [05/21/2021-05:49:16] [V] [TRT] Tactic: 7274495 Time: 0.0321 [05/21/2021-05:49:16] [V] [TRT] Tactic: 7864319 Time: 0.033664 [05/21/2021-05:49:16] [V] [TRT] Tactic: 7995391 Time: 0.095232 [05/21/2021-05:49:16] [V] [TRT] Tactic: 8585215 Time: 0.12096 [05/21/2021-05:49:16] [V] [TRT] Tactic: 8847359 Time: 0.034368 [05/21/2021-05:49:16] [V] [TRT] Tactic: 8978431 Time: 0.162048 [05/21/2021-05:49:16] [V] [TRT] Tactic: 9043967 Time: 0.043848 [05/21/2021-05:49:16] [V] [TRT] Tactic: 9175039 Time: 0.044496 [05/21/2021-05:49:16] [V] [TRT] Tactic: 9502719 Time: 0.180112 [05/21/2021-05:49:16] [V] [TRT] Tactic: 9830399 Time: 0.08768 [05/21/2021-05:49:16] [V] [TRT] Tactic: 9961471 Time: 0.036264 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10027007 Time: 0.06618 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10092543 Time: 0.187956 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10289151 Time: 0.17408 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10485759 Time: 0.034944 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10682367 Time: 0.029824 [05/21/2021-05:49:16] [V] [TRT] Tactic: 10813439 Time: 0.04814 [05/21/2021-05:49:16] [V] [TRT] Fastest Tactic: 10682367 Time: 0.029824 [05/21/2021-05:49:16] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:16] [V] [TRT] Tactic: 0 Time: 0.096596 [05/21/2021-05:49:16] [V] [TRT] Tactic: 1 Time: 0.068856 [05/21/2021-05:49:16] [V] [TRT] Tactic: 2 Time: 0.1536 [05/21/2021-05:49:16] [V] [TRT] Tactic: 4 Time: 0.248828 [05/21/2021-05:49:16] [V] [TRT] Tactic: 5 Time: 0.746484 [05/21/2021-05:49:16] [V] [TRT] Tactic: 6 Time: 0.05408 [05/21/2021-05:49:16] [V] [TRT] Tactic: 56 Time: 0.11584 [05/21/2021-05:49:17] [V] [TRT] Tactic: 57 Time: 0.068248 [05/21/2021-05:49:17] [V] [TRT] Tactic: 58 Time: 0.15284 [05/21/2021-05:49:17] [V] [TRT] Tactic: 60 Time: 0.248132 [05/21/2021-05:49:17] [V] [TRT] Tactic: 61 Time: 0.7464 [05/21/2021-05:49:17] [V] [TRT] Tactic: 62 Time: 0.054272 [05/21/2021-05:49:17] [V] [TRT] Tactic: 112 Time: 0.114932 [05/21/2021-05:49:17] [V] [TRT] Tactic: 113 Time: 0.125804 [05/21/2021-05:49:17] [V] [TRT] Tactic: 114 Time: 0.15292 [05/21/2021-05:49:17] [V] [TRT] Tactic: 116 Time: 0.248024 [05/21/2021-05:49:17] [V] [TRT] Tactic: 117 Time: 0.745856 [05/21/2021-05:49:17] [V] [TRT] Tactic: 118 Time: 0.053992 [05/21/2021-05:49:17] [V] [TRT] Fastest Tactic: 118 Time: 0.053992 [05/21/2021-05:49:17] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4549827808004681195 Time: 0.193536 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:17] [V] [TRT] Tactic: 5779835512569528575 Time: 0.24794 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:49:17] [V] [TRT] Tactic: 6053873026024413720 Time: 0.262148 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:49:17] [V] [TRT] Tactic: 6767548733843469815 Time: 0.208524 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:17] [V] [TRT] Tactic: -6313876406580483184 Time: 0.247424 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:17] [V] [TRT] Tactic: -1123676555321336786 Time: 0.258708 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:17] [V] [TRT] Tactic: -701551393537224327 Time: 0.225556 [05/21/2021-05:49:17] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.193536 [05/21/2021-05:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [05/21/2021-05:49:17] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:17] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:17] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:17] [V] [TRT] Tactic: 2860655430572478466 Time: 0.146648 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4474630279712975759 Time: 0.082028 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4479823862704990365 Time: 0.079112 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4696204239951173149 Time: 0.146456 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:17] [V] [TRT] Tactic: 5778138195697110003 Time: 0.256384 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:49:17] [V] [TRT] Tactic: 7155825427510256858 Time: 0.245132 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:17] [V] [TRT] Tactic: 8918020581761223752 Time: 0.242312 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:49:17] [V] [TRT] Tactic: -4756382386362004279 Time: 0.144556 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:49:17] [V] [TRT] Tactic: -3855385237722507464 Time: 0.257024 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:17] [V] [TRT] Tactic: -2809379259463049391 Time: 0.252688 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:17] [V] [TRT] Tactic: -504296718212024303 Time: 0.241316 [05/21/2021-05:49:17] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.079112 [05/21/2021-05:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:49:17] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:17] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:17] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:17] [V] [TRT] Tactic: 2860655430572478466 Time: 0.146888 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4474630279712975759 Time: 0.08184 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4479823862704990365 Time: 0.079256 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:17] [V] [TRT] Tactic: 4696204239951173149 Time: 0.146304 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:17] [V] [TRT] Tactic: 5778138195697110003 Time: 0.257024 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:49:17] [V] [TRT] Tactic: 7155825427510256858 Time: 0.246556 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:49:17] [V] [TRT] Tactic: 7342025736444949634 Time: 0.169728 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:17] [V] [TRT] Tactic: 8918020581761223752 Time: 0.241212 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:49:17] [V] [TRT] Tactic: -7377458734869418330 Time: 0.167728 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:49:17] [V] [TRT] Tactic: -5457304872213719461 Time: 0.168704 [05/21/2021-05:49:17] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:49:18] [V] [TRT] Tactic: -4756382386362004279 Time: 0.144768 [05/21/2021-05:49:18] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:49:18] [V] [TRT] Tactic: -3855385237722507464 Time: 0.25716 [05/21/2021-05:49:18] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:18] [V] [TRT] Tactic: -2809379259463049391 Time: 0.252416 [05/21/2021-05:49:18] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:18] [V] [TRT] Tactic: -504296718212024303 Time: 0.241324 [05/21/2021-05:49:18] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.079256 [05/21/2021-05:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:49:18] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:18] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:18] [V] [TRT] Tactic: 0 Time: 0.124016 [05/21/2021-05:49:18] [V] [TRT] Tactic: 1 Time: 0.124464 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2 Time: 0.107844 [05/21/2021-05:49:18] [V] [TRT] Tactic: 4 Time: 0.245708 [05/21/2021-05:49:18] [V] [TRT] Tactic: 5 Time: 0.736552 [05/21/2021-05:49:18] [V] [TRT] Tactic: 6 Time: 0.071836 [05/21/2021-05:49:18] [V] [TRT] Tactic: 56 Time: 0.124844 [05/21/2021-05:49:18] [V] [TRT] Tactic: 58 Time: 0.111232 [05/21/2021-05:49:18] [V] [TRT] Tactic: 60 Time: 0.246816 [05/21/2021-05:49:18] [V] [TRT] Tactic: 61 Time: 0.735144 [05/21/2021-05:49:18] [V] [TRT] Tactic: 62 Time: 0.071616 [05/21/2021-05:49:18] [V] [TRT] Fastest Tactic: 62 Time: 0.071616 [05/21/2021-05:49:18] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62 [05/21/2021-05:49:18] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:18] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:49:18] [V] [TRT] Tactic: 524287 Time: 0.066264 [05/21/2021-05:49:18] [V] [TRT] Tactic: 720895 Time: 0.055808 [05/21/2021-05:49:18] [V] [TRT] Tactic: 983039 Time: 0.029176 [05/21/2021-05:49:18] [V] [TRT] Tactic: 1048575 Time: 0.044316 [05/21/2021-05:49:18] [V] [TRT] Tactic: 1703935 Time: 0.025472 [05/21/2021-05:49:18] [V] [TRT] Tactic: 1769471 Time: 0.029312 [05/21/2021-05:49:18] [V] [TRT] Tactic: 1966079 Time: 0.109868 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2031615 Time: 0.0928 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2228223 Time: 0.046376 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2424831 Time: 0.021548 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2621439 Time: 0.020704 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2752511 Time: 0.06144 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2818047 Time: 0.05548 [05/21/2021-05:49:18] [V] [TRT] Tactic: 2883583 Time: 0.132096 [05/21/2021-05:49:18] [V] [TRT] Tactic: 3014655 Time: 0.029696 [05/21/2021-05:49:18] [V] [TRT] Tactic: 3145727 Time: 0.033024 [05/21/2021-05:49:18] [V] [TRT] Tactic: 3473407 Time: 0.068796 [05/21/2021-05:49:18] [V] [TRT] Tactic: 3604479 Time: 0.030208 [05/21/2021-05:49:18] [V] [TRT] Tactic: 3735551 Time: 0.05312 [05/21/2021-05:49:18] [V] [TRT] Tactic: 4390911 Time: 0.11908 [05/21/2021-05:49:18] [V] [TRT] Tactic: 5046271 Time: 0.036032 [05/21/2021-05:49:18] [V] [TRT] Tactic: 5963775 Time: 0.10188 [05/21/2021-05:49:18] [V] [TRT] Tactic: 6160383 Time: 0.06016 [05/21/2021-05:49:18] [V] [TRT] Tactic: 6488063 Time: 0.054188 [05/21/2021-05:49:18] [V] [TRT] Tactic: 6881279 Time: 0.083448 [05/21/2021-05:49:18] [V] [TRT] Tactic: 7274495 Time: 0.022272 [05/21/2021-05:49:18] [V] [TRT] Tactic: 7864319 Time: 0.020712 [05/21/2021-05:49:18] [V] [TRT] Tactic: 7995391 Time: 0.058724 [05/21/2021-05:49:18] [V] [TRT] Tactic: 8585215 Time: 0.07488 [05/21/2021-05:49:18] [V] [TRT] Tactic: 8847359 Time: 0.022528 [05/21/2021-05:49:18] [V] [TRT] Tactic: 8978431 Time: 0.09984 [05/21/2021-05:49:18] [V] [TRT] Tactic: 9043967 Time: 0.028288 [05/21/2021-05:49:18] [V] [TRT] Tactic: 9175039 Time: 0.030072 [05/21/2021-05:49:18] [V] [TRT] Tactic: 9502719 Time: 0.118808 [05/21/2021-05:49:18] [V] [TRT] Tactic: 9830399 Time: 0.056244 [05/21/2021-05:49:19] [V] [TRT] Tactic: 9961471 Time: 0.024448 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10027007 Time: 0.040576 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10092543 Time: 0.119168 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10289151 Time: 0.109752 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10485759 Time: 0.02252 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10682367 Time: 0.020508 [05/21/2021-05:49:19] [V] [TRT] Tactic: 10813439 Time: 0.0318 [05/21/2021-05:49:19] [V] [TRT] Fastest Tactic: 10682367 Time: 0.020508 [05/21/2021-05:49:19] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:19] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:19] [V] [TRT] Tactic: 2195670545862694453 Time: 0.124444 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:49:19] [V] [TRT] Tactic: 3419182076704469245 Time: 0.119204 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:19] [V] [TRT] Tactic: 3891805945559659536 Time: 0.165668 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:19] [V] [TRT] Tactic: 5548126322150286555 Time: 0.116864 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:19] [V] [TRT] Tactic: 6057304366605292508 Time: 0.100364 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:49:19] [V] [TRT] Tactic: -7928611605886347652 Time: 0.172204 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:49:19] [V] [TRT] Tactic: -5172391392092686714 Time: 0.138048 [05/21/2021-05:49:19] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:20] [V] [TRT] Tactic: -4374269919094467161 Time: 0.100736 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953 [05/21/2021-05:49:20] [V] [TRT] Tactic: -4083394051665370953 Time: 0.026752 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:20] [V] [TRT] Tactic: -1546027692247304867 Time: 0.164368 [05/21/2021-05:49:20] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.026752 [05/21/2021-05:49:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [05/21/2021-05:49:20] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:20] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:20] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:20] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:20] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:49:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:20] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:20] [V] [TRT] Tactic: 0 Time: 1.16902 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1 Time: 0.294092 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2 Time: 0.115328 [05/21/2021-05:49:20] [V] [TRT] Tactic: 6 Time: 0.067968 [05/21/2021-05:49:20] [V] [TRT] Tactic: 56 Time: 1.16902 [05/21/2021-05:49:20] [V] [TRT] Tactic: 58 Time: 0.11264 [05/21/2021-05:49:20] [V] [TRT] Tactic: 62 Time: 0.067712 [05/21/2021-05:49:20] [V] [TRT] Fastest Tactic: 62 Time: 0.067712 [05/21/2021-05:49:20] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:20] [V] [TRT] Tactic: 254850674756030979 Time: 0.086616 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:49:20] [V] [TRT] Tactic: 328038211831149625 Time: 0.084992 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:49:20] [V] [TRT] Tactic: 411553864378931917 Time: 0.026076 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1011057357468998345 Time: 0.04928 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1156328698016730421 Time: 0.052168 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1723736032573714698 Time: 0.025872 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1832046141070096030 Time: 0.026496 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1838082074606840426 Time: 0.026292 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:20] [V] [TRT] Tactic: 1899296423087490472 Time: 0.015744 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2428167804343994714 Time: 0.025716 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2541579301352125276 Time: 0.04616 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2657157263811141609 Time: 0.016512 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2819719497590964443 Time: 0.027004 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2968605903460894194 Time: 0.026636 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:49:20] [V] [TRT] Tactic: 2986078304285316765 Time: 0.047104 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:20] [V] [TRT] Tactic: 3362537467505018070 Time: 0.045568 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:20] [V] [TRT] Tactic: 3513075359009385578 Time: 0.087068 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:49:20] [V] [TRT] Tactic: 3573559043797674382 Time: 0.027112 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:49:20] [V] [TRT] Tactic: 3591970081995419777 Time: 0.015872 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:20] [V] [TRT] Tactic: 3704534001553878387 Time: 0.04736 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:20] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0256 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:49:20] [V] [TRT] Tactic: 4503233883285355107 Time: 0.018696 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:20] [V] [TRT] Tactic: 4802447371470387646 Time: 0.047904 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:20] [V] [TRT] Tactic: 5059676457552313631 Time: 0.084908 [05/21/2021-05:49:20] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:49:21] [V] [TRT] Tactic: 5368829646735632944 Time: 0.01732 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:21] [V] [TRT] Tactic: 5398999388616959893 Time: 0.048 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:49:21] [V] [TRT] Tactic: 5746691132547383910 Time: 0.02668 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:49:21] [V] [TRT] Tactic: 5770170567977052602 Time: 0.050288 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:49:21] [V] [TRT] Tactic: 5953552212833506549 Time: 0.046024 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6034364043891107501 Time: 0.025604 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6074229447555668232 Time: 0.017408 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6154447660803990543 Time: 0.024832 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6325769668000961702 Time: 0.044524 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6350273239113254096 Time: 0.013312 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6377497238381488891 Time: 0.045792 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6446388116965632819 Time: 0.026668 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6468794451065529747 Time: 0.026756 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6642277870194067185 Time: 0.08844 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6859477213531075460 Time: 0.017008 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6972489290272968208 Time: 0.046108 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:49:21] [V] [TRT] Tactic: 6979044990896381511 Time: 0.084256 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:21] [V] [TRT] Tactic: 7216571380637776659 Time: 0.057564 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:21] [V] [TRT] Tactic: 7609923741161019135 Time: 0.025816 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:49:21] [V] [TRT] Tactic: 7705739241028240201 Time: 0.017432 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:49:21] [V] [TRT] Tactic: 8072087735545283117 Time: 0.085124 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:21] [V] [TRT] Tactic: 8101703987960976805 Time: 0.017408 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:21] [V] [TRT] Tactic: 8170606396342855895 Time: 0.026624 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:21] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0518 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:49:21] [V] [TRT] Tactic: -9217371357561775773 Time: 0.018048 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:21] [V] [TRT] Tactic: -9009272790678027912 Time: 0.052396 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:49:21] [V] [TRT] Tactic: -8985224497679592364 Time: 0.019936 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:49:21] [V] [TRT] Tactic: -8949544755481315679 Time: 0.027308 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:49:21] [V] [TRT] Tactic: -8759929675070720385 Time: 0.046696 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:21] [V] [TRT] Tactic: -8604374562669615024 Time: 0.017328 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013228 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6840588038605932325 Time: 0.025636 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6799856376604253964 Time: 0.083836 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6625722781282978136 Time: 0.026796 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6525498856028268801 Time: 0.04736 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01844 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6324345858751792783 Time: 0.027276 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6262400699544994312 Time: 0.084712 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:49:21] [V] [TRT] Tactic: -6257787336162086472 Time: 0.052912 [05/21/2021-05:49:21] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:22] [V] [TRT] Tactic: -6063766379489217211 Time: 0.026516 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5777580938094193096 Time: 0.027444 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5657273398217409378 Time: 0.086536 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5530886555766748586 Time: 0.045076 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5422685219138380548 Time: 0.024576 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5161596964442251102 Time: 0.026496 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:22] [V] [TRT] Tactic: -5127240325355316006 Time: 0.025604 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4825567853927730435 Time: 0.026112 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4796511246675321840 Time: 0.02656 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4706569565442112734 Time: 0.01802 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4566599693570369588 Time: 0.046032 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4409144516525410768 Time: 0.045952 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4379519430184503304 Time: 0.026112 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4152066959007262150 Time: 0.08652 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:22] [V] [TRT] Tactic: -4021926646879732549 Time: 0.025888 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3987638434926559037 Time: 0.025984 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3905653247016903130 Time: 0.049152 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3903974568488493144 Time: 0.027776 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3895429239811098010 Time: 0.025788 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3864869056275745423 Time: 0.047172 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3601464762214218301 Time: 0.016416 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3412636942650049698 Time: 0.049432 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3338665856053412950 Time: 0.046224 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:22] [V] [TRT] Tactic: -3058330359340425555 Time: 0.026168 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2816084650627734155 Time: 0.052532 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2662892962457732243 Time: 0.025816 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2559894581585337900 Time: 0.084992 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2530740716768816092 Time: 0.044152 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2332828394978346992 Time: 0.044664 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2241736083352441442 Time: 0.057448 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:49:22] [V] [TRT] Tactic: -2161909437867201546 Time: 0.015744 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:22] [V] [TRT] Tactic: -1985778916402815946 Time: 0.050304 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:49:22] [V] [TRT] Tactic: -1500496213132463076 Time: 0.02768 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:22] [V] [TRT] Tactic: -1099247066487349374 Time: 0.016608 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:49:22] [V] [TRT] Tactic: -910286698936744682 Time: 0.016032 [05/21/2021-05:49:22] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:49:22] [V] [TRT] Tactic: -606726295133751039 Time: 0.02688 [05/21/2021-05:49:22] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.013228 [05/21/2021-05:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166 [05/21/2021-05:49:22] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:22] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution) [05/21/2021-05:49:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:22] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution) [05/21/2021-05:49:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:22] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:22] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudaDepthwiseConvolution) [05/21/2021-05:49:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:22] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (FusedConvActConvolution) [05/21/2021-05:49:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:22] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:22] [V] [TRT] Tactic: 0 Time: 0.024312 [05/21/2021-05:49:22] [V] [TRT] Tactic: 1 Time: 0.023304 [05/21/2021-05:49:22] [V] [TRT] Tactic: 2 Time: 0.08192 [05/21/2021-05:49:22] [V] [TRT] Tactic: 4 Time: 0.88944 [05/21/2021-05:49:22] [V] [TRT] Tactic: 5 Time: 0.212864 [05/21/2021-05:49:23] [V] [TRT] Tactic: 56 Time: 0.022528 [05/21/2021-05:49:23] [V] [TRT] Tactic: 57 Time: 0.022516 [05/21/2021-05:49:23] [V] [TRT] Tactic: 58 Time: 0.081784 [05/21/2021-05:49:23] [V] [TRT] Tactic: 60 Time: 0.888596 [05/21/2021-05:49:23] [V] [TRT] Tactic: 61 Time: 0.206028 [05/21/2021-05:49:23] [V] [TRT] Tactic: 112 Time: 0.024968 [05/21/2021-05:49:23] [V] [TRT] Tactic: 113 Time: 0.023552 [05/21/2021-05:49:23] [V] [TRT] Tactic: 114 Time: 0.092572 [05/21/2021-05:49:23] [V] [TRT] Tactic: 116 Time: 0.88864 [05/21/2021-05:49:23] [V] [TRT] Tactic: 117 Time: 0.213648 [05/21/2021-05:49:23] [V] [TRT] Fastest Tactic: 57 Time: 0.022516 [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4549827808004681195 Time: 0.03024 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:23] [V] [TRT] Tactic: 5779835512569528575 Time: 0.036836 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:23] [V] [TRT] Tactic: 9151672657204310840 Time: 0.048164 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:23] [V] [TRT] Tactic: -7491730084094677098 Time: 0.035392 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:49:23] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0396 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:23] [V] [TRT] Tactic: -6313876406580483184 Time: 0.035844 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:23] [V] [TRT] Tactic: -6273689210331812572 Time: 0.03596 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:23] [V] [TRT] Tactic: -4337126844824617177 Time: 0.027644 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:23] [V] [TRT] Tactic: -1123676555321336786 Time: 0.03584 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:23] [V] [TRT] Tactic: -701551393537224327 Time: 0.03136 [05/21/2021-05:49:23] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.027644 [05/21/2021-05:49:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 57 [05/21/2021-05:49:23] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:23] [V] [TRT] Tactic: 1663866669559596164 Time: 0.036992 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:23] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024384 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017424 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017056 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4696204239951173149 Time: 0.023412 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:23] [V] [TRT] Tactic: 5778138195697110003 Time: 0.03736 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:23] [V] [TRT] Tactic: 8918020581761223752 Time: 0.033664 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:23] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02124 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:23] [V] [TRT] Tactic: -4035591156787122265 Time: 0.015792 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:23] [V] [TRT] Tactic: -2809379259463049391 Time: 0.03586 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:23] [V] [TRT] Tactic: -1985235291706575900 Time: 0.035136 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:23] [V] [TRT] Tactic: -504296718212024303 Time: 0.035456 [05/21/2021-05:49:23] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.015792 [05/21/2021-05:49:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:23] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:23] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:23] [V] [TRT] Tactic: 1373022415249282411 Time: 0.02752 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:23] [V] [TRT] Tactic: 1663866669559596164 Time: 0.036948 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:23] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024296 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4474630279712975759 Time: 0.01746 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01728 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:23] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02334 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:23] [V] [TRT] Tactic: 5778138195697110003 Time: 0.036224 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:23] [V] [TRT] Tactic: 8918020581761223752 Time: 0.033792 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:49:23] [V] [TRT] Tactic: -7067026478815706014 Time: 0.025704 [05/21/2021-05:49:23] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:24] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022696 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:24] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016664 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:24] [V] [TRT] Tactic: -2809379259463049391 Time: 0.037092 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:24] [V] [TRT] Tactic: -1985235291706575900 Time: 0.034496 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:24] [V] [TRT] Tactic: -504296718212024303 Time: 0.034888 [05/21/2021-05:49:24] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.016664 [05/21/2021-05:49:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:24] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:24] [V] [TRT] Tactic: 0 Time: 0.024928 [05/21/2021-05:49:24] [V] [TRT] Tactic: 1 Time: 0.024872 [05/21/2021-05:49:24] [V] [TRT] Tactic: 2 Time: 0.084876 [05/21/2021-05:49:24] [V] [TRT] Tactic: 4 Time: 0.880472 [05/21/2021-05:49:24] [V] [TRT] Tactic: 5 Time: 0.211704 [05/21/2021-05:49:24] [V] [TRT] Tactic: 56 Time: 0.0251 [05/21/2021-05:49:24] [V] [TRT] Tactic: 58 Time: 0.085256 [05/21/2021-05:49:24] [V] [TRT] Tactic: 60 Time: 0.880912 [05/21/2021-05:49:24] [V] [TRT] Tactic: 61 Time: 0.209992 [05/21/2021-05:49:24] [V] [TRT] Fastest Tactic: 1 Time: 0.024872 [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:49:24] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (FusedConvActConvolution) [05/21/2021-05:49:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:24] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:24] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:24] [V] [TRT] Tactic: 2195670545862694453 Time: 0.019624 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:24] [V] [TRT] Tactic: 3891805945559659536 Time: 0.025072 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:24] [V] [TRT] Tactic: 4418200634486186714 Time: 0.017436 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:24] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018568 [05/21/2021-05:49:24] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:25] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017836 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:25] [V] [TRT] Tactic: 7392644644614664811 Time: 0.016996 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:25] [V] [TRT] Tactic: -4884039206922900293 Time: 0.023924 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:25] [V] [TRT] Tactic: -4374269919094467161 Time: 0.017416 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:25] [V] [TRT] Tactic: -1546027692247304867 Time: 0.025216 [05/21/2021-05:49:25] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.016996 [05/21/2021-05:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811 [05/21/2021-05:49:25] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:25] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:25] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudaDepthwiseConvolution) [05/21/2021-05:49:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:25] [V] [TRT] Tactic: 0 Time: 0.031836 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1 Time: 0.02882 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2 Time: 0.06932 [05/21/2021-05:49:25] [V] [TRT] Tactic: 56 Time: 0.031916 [05/21/2021-05:49:25] [V] [TRT] Tactic: 58 Time: 0.069304 [05/21/2021-05:49:25] [V] [TRT] Fastest Tactic: 1 Time: 0.02882 [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:25] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:25] [V] [TRT] Tactic: 254850674756030979 Time: 0.017264 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1156328698016730421 Time: 0.012288 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012264 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1576319725282257846 Time: 0.009712 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1832046141070096030 Time: 0.00958 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1838082074606840426 Time: 0.010272 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:25] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008836 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009684 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01218 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0165 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2657157263811141609 Time: 0.008888 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:25] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009844 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009984 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3359475309458902373 Time: 0.008192 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01152 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3513075359009385578 Time: 0.018176 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3704534001553878387 Time: 0.012416 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:49:25] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007316 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009232 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0089 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008832 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01644 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01024 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:49:25] [V] [TRT] Tactic: 4571819373777460444 Time: 0.016792 [05/21/2021-05:49:25] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:49:26] [V] [TRT] Tactic: 4595173549602041350 Time: 0.017116 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:26] [V] [TRT] Tactic: 4802447371470387646 Time: 0.012448 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:49:26] [V] [TRT] Tactic: 4993757826442493905 Time: 0.008836 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:26] [V] [TRT] Tactic: 5059676457552313631 Time: 0.017092 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:49:26] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011832 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:49:26] [V] [TRT] Tactic: 5346855796032465921 Time: 0.012748 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:26] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012536 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:26] [V] [TRT] Tactic: 6034364043891107501 Time: 0.008696 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:26] [V] [TRT] Tactic: 6377497238381488891 Time: 0.012016 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:26] [V] [TRT] Tactic: 6468794451065529747 Time: 0.010224 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:49:26] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00818 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:26] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008192 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:26] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013724 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:26] [V] [TRT] Tactic: 7609923741161019135 Time: 0.009284 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:26] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009088 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:26] [V] [TRT] Tactic: 8170606396342855895 Time: 0.010372 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:49:26] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012224 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:49:26] [V] [TRT] Tactic: 8823554289762712606 Time: 0.009208 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:26] [V] [TRT] Tactic: 8839784824303350101 Time: 0.012448 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:49:26] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007808 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:26] [V] [TRT] Tactic: -9009272790678027912 Time: 0.012416 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:26] [V] [TRT] Tactic: -8604374562669615024 Time: 0.008308 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:49:26] [V] [TRT] Tactic: -8280443484414412687 Time: 0.017408 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:49:26] [V] [TRT] Tactic: -8205952393017864204 Time: 0.016872 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:49:26] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009984 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:49:26] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008692 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:49:26] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008304 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:49:26] [V] [TRT] Tactic: -7089118800560870395 Time: 0.007768 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:49:26] [V] [TRT] Tactic: -6768327495007644783 Time: 0.012032 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:26] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009036 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:26] [V] [TRT] Tactic: -6063766379489217211 Time: 0.009228 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:26] [V] [TRT] Tactic: -5530886555766748586 Time: 0.011776 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:49:26] [V] [TRT] Tactic: -5409588854490562130 Time: 0.007168 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:26] [V] [TRT] Tactic: -5161596964442251102 Time: 0.010112 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:26] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008652 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:49:26] [V] [TRT] Tactic: -4950923835688973492 Time: 0.007572 [05/21/2021-05:49:26] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4796511246675321840 Time: 0.010344 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008496 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4379519430184503304 Time: 0.009216 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4293222705763522367 Time: 0.007936 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4152066959007262150 Time: 0.017024 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:27] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0092 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009772 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3905653247016903130 Time: 0.013148 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012204 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3864869056275745423 Time: 0.012552 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3601464762214218301 Time: 0.007936 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:27] [V] [TRT] Tactic: -3058330359340425555 Time: 0.009772 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:27] [V] [TRT] Tactic: -2878731503146438856 Time: 0.011864 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:27] [V] [TRT] Tactic: -2602982885923184927 Time: 0.012212 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:27] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012276 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:27] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009764 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:27] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0083 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1985778916402815946 Time: 0.012552 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010624 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009728 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1562548049711204899 Time: 0.01216 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009124 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008204 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:27] [V] [TRT] Tactic: -1038291877007553549 Time: 0.00944 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:27] [V] [TRT] Tactic: -406984317033388136 Time: 0.01216 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:27] [V] [TRT] Tactic: -331499326992534460 Time: 0.008916 [05/21/2021-05:49:27] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:49:27] [V] [TRT] Tactic: -206523504474952360 Time: 0.012524 [05/21/2021-05:49:27] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.007168 [05/21/2021-05:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130 [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution) [05/21/2021-05:49:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution) [05/21/2021-05:49:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution) [05/21/2021-05:49:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Tactic: 0 Time: 0.004584 [05/21/2021-05:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004584 [05/21/2021-05:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Tactic: 0 Time: 0.006144 [05/21/2021-05:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [05/21/2021-05:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale) [05/21/2021-05:49:27] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CaskConvolution) [05/21/2021-05:49:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CudnnConvolution) [05/21/2021-05:49:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CublasConvolution) [05/21/2021-05:49:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CaskConvolution) [05/21/2021-05:49:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CudnnConvolution) [05/21/2021-05:49:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CublasConvolution) [05/21/2021-05:49:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CaskConvolution) [05/21/2021-05:49:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:27] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CudnnConvolution) [05/21/2021-05:49:27] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.00498 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00498 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.00602 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00602 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.005112 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.004324 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004324 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.00524 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00524 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.00454 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00454 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Tactic: 0 Time: 0.006184 [05/21/2021-05:49:28] [V] [TRT] Fastest Tactic: 0 Time: 0.006184 [05/21/2021-05:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale) [05/21/2021-05:49:28] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CaskConvolution) [05/21/2021-05:49:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CudnnConvolution) [05/21/2021-05:49:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CublasConvolution) [05/21/2021-05:49:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:28] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CudnnConvolution) [05/21/2021-05:49:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CublasConvolution) [05/21/2021-05:49:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CudnnConvolution) [05/21/2021-05:49:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CudnnConvolution) [05/21/2021-05:49:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CudnnConvolution) [05/21/2021-05:49:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CublasConvolution) [05/21/2021-05:49:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CudnnConvolution) [05/21/2021-05:49:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CublasConvolution) [05/21/2021-05:49:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CaskConvolution) [05/21/2021-05:49:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Tactic: 0 Time: 0.004828 [05/21/2021-05:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004828 [05/21/2021-05:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Tactic: 0 Time: 0.004652 [05/21/2021-05:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004652 [05/21/2021-05:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Tactic: 0 Time: 0.00476 [05/21/2021-05:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.00476 [05/21/2021-05:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Tactic: 0 Time: 0.00552 [05/21/2021-05:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.00552 [05/21/2021-05:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale) [05/21/2021-05:49:29] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(100352,196,14,1) *************** [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:49:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:49:29] [V] [TRT] Tactic: 589823 Time: 0.211968 [05/21/2021-05:49:29] [V] [TRT] Tactic: 655359 Time: 0.164228 [05/21/2021-05:49:29] [V] [TRT] Tactic: 786431 Time: 0.06 [05/21/2021-05:49:29] [V] [TRT] Tactic: 851967 Time: 0.047104 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1179647 Time: 0.035748 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1310719 Time: 0.11192 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1376255 Time: 0.181996 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1441791 Time: 0.031504 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1507327 Time: 0.090752 [05/21/2021-05:49:29] [V] [TRT] Tactic: 1638399 Time: 0.037632 [05/21/2021-05:49:30] [V] [TRT] Tactic: 1835007 Time: 0.061604 [05/21/2021-05:49:30] [V] [TRT] Tactic: 1900543 Time: 0.174516 [05/21/2021-05:49:30] [V] [TRT] Tactic: 2097151 Time: 0.030712 [05/21/2021-05:49:30] [V] [TRT] Tactic: 2162687 Time: 0.179292 [05/21/2021-05:49:30] [V] [TRT] Tactic: 2293759 Time: 0.167544 [05/21/2021-05:49:30] [V] [TRT] Tactic: 2359295 Time: 0.096428 [05/21/2021-05:49:30] [V] [TRT] Tactic: 2686975 Time: 0.171452 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3080191 Time: 0.080384 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3342335 Time: 0.090804 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3407871 Time: 0.087512 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3538943 Time: 0.050176 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3670015 Time: 0.324224 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3932159 Time: 0.115704 [05/21/2021-05:49:30] [V] [TRT] Tactic: 3997695 Time: 0.035372 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4063231 Time: 0.04216 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4194303 Time: 0.054276 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4259839 Time: 0.032768 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4325375 Time: 0.05352 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4521983 Time: 0.165504 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4587519 Time: 0.038612 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4653055 Time: 0.031628 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4915199 Time: 0.037552 [05/21/2021-05:49:30] [V] [TRT] Tactic: 4980735 Time: 0.086736 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5177343 Time: 0.038068 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5242879 Time: 0.0821 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5373951 Time: 0.038388 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5439487 Time: 0.058772 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5570559 Time: 0.08808 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5636095 Time: 0.046464 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5701631 Time: 0.129024 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5767167 Time: 0.074368 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5832703 Time: 0.070656 [05/21/2021-05:49:30] [V] [TRT] Tactic: 5898239 Time: 0.028232 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6029311 Time: 0.125096 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6225919 Time: 0.050692 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6291455 Time: 0.03576 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6422527 Time: 0.078204 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6750207 Time: 0.038736 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6815743 Time: 0.088972 [05/21/2021-05:49:30] [V] [TRT] Tactic: 6946815 Time: 0.057984 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7012351 Time: 0.03072 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7077887 Time: 0.051832 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7143423 Time: 0.092544 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7208959 Time: 0.086824 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7340031 Time: 0.03456 [05/21/2021-05:49:30] [V] [TRT] Tactic: 7405567 Time: 0.036864 [05/21/2021-05:49:31] [V] [TRT] Tactic: 7536639 Time: 0.114708 [05/21/2021-05:49:31] [V] [TRT] Tactic: 7602175 Time: 0.0506 [05/21/2021-05:49:31] [V] [TRT] Tactic: 7733247 Time: 0.04416 [05/21/2021-05:49:31] [V] [TRT] Tactic: 7798783 Time: 0.050976 [05/21/2021-05:49:31] [V] [TRT] Tactic: 8191999 Time: 0.057088 [05/21/2021-05:49:31] [V] [TRT] Tactic: 8257535 Time: 0.03896 [05/21/2021-05:49:31] [V] [TRT] Tactic: 8323071 Time: 0.059508 [05/21/2021-05:49:31] [V] [TRT] Tactic: 8650751 Time: 0.055936 [05/21/2021-05:49:31] [V] [TRT] Tactic: 8716287 Time: 0.050472 [05/21/2021-05:49:31] [V] [TRT] Tactic: 9109503 Time: 0.03192 [05/21/2021-05:49:31] [V] [TRT] Tactic: 9568255 Time: 0.037416 [05/21/2021-05:49:31] [V] [TRT] Tactic: 9895935 Time: 0.065792 [05/21/2021-05:49:31] [V] [TRT] Tactic: 10223615 Time: 0.173872 [05/21/2021-05:49:31] [V] [TRT] Tactic: 10354687 Time: 0.039196 [05/21/2021-05:49:31] [V] [TRT] Tactic: 10551295 Time: 0.077824 [05/21/2021-05:49:31] [V] [TRT] Tactic: 10747903 Time: 0.043008 [05/21/2021-05:49:31] [V] [TRT] Tactic: 10944511 Time: 0.070656 [05/21/2021-05:49:31] [V] [TRT] Fastest Tactic: 5898239 Time: 0.028232 [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:31] [V] [TRT] Tactic: 0 Time: 0.047636 [05/21/2021-05:49:31] [V] [TRT] Tactic: 1 Time: 0.058852 [05/21/2021-05:49:31] [V] [TRT] Tactic: 2 Time: 0.162816 [05/21/2021-05:49:31] [V] [TRT] Tactic: 4 Time: 1.74786 [05/21/2021-05:49:31] [V] [TRT] Tactic: 5 Time: 0.392676 [05/21/2021-05:49:31] [V] [TRT] Tactic: 56 Time: 0.06588 [05/21/2021-05:49:31] [V] [TRT] Tactic: 57 Time: 0.052716 [05/21/2021-05:49:31] [V] [TRT] Tactic: 58 Time: 0.159964 [05/21/2021-05:49:31] [V] [TRT] Tactic: 60 Time: 1.7448 [05/21/2021-05:49:31] [V] [TRT] Tactic: 61 Time: 0.392796 [05/21/2021-05:49:31] [V] [TRT] Tactic: 112 Time: 0.066668 [05/21/2021-05:49:31] [V] [TRT] Tactic: 113 Time: 0.05348 [05/21/2021-05:49:31] [V] [TRT] Tactic: 114 Time: 0.160712 [05/21/2021-05:49:31] [V] [TRT] Tactic: 116 Time: 1.7459 [05/21/2021-05:49:31] [V] [TRT] Tactic: 117 Time: 0.39254 [05/21/2021-05:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.047636 [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:31] [V] [TRT] Tactic: 4549827808004681195 Time: 0.09178 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:31] [V] [TRT] Tactic: 5779835512569528575 Time: 0.116224 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:31] [V] [TRT] Tactic: 9151672657204310840 Time: 0.109108 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:31] [V] [TRT] Tactic: -7491730084094677098 Time: 0.126836 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:49:31] [V] [TRT] Tactic: -6622064180404051845 Time: 0.099032 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:31] [V] [TRT] Tactic: -6313876406580483184 Time: 0.115852 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:31] [V] [TRT] Tactic: -6273689210331812572 Time: 0.113392 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:31] [V] [TRT] Tactic: -4337126844824617177 Time: 0.082928 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:31] [V] [TRT] Tactic: -1123676555321336786 Time: 0.113664 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:31] [V] [TRT] Tactic: -701551393537224327 Time: 0.098152 [05/21/2021-05:49:31] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.082928 [05/21/2021-05:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239 [05/21/2021-05:49:31] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(100352,1,7168,512) *************** [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:31] [V] [TRT] Tactic: 1663866669559596164 Time: 0.12262 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:31] [V] [TRT] Tactic: 2860655430572478466 Time: 0.06996 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:31] [V] [TRT] Tactic: 4474630279712975759 Time: 0.040596 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:31] [V] [TRT] Tactic: 4479823862704990365 Time: 0.039984 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:31] [V] [TRT] Tactic: 4696204239951173149 Time: 0.069272 [05/21/2021-05:49:31] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:32] [V] [TRT] Tactic: 5778138195697110003 Time: 0.123932 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:32] [V] [TRT] Tactic: 8918020581761223752 Time: 0.110664 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:32] [V] [TRT] Tactic: -5905193483742532701 Time: 0.062056 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:32] [V] [TRT] Tactic: -4035591156787122265 Time: 0.03844 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:32] [V] [TRT] Tactic: -2809379259463049391 Time: 0.120304 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:32] [V] [TRT] Tactic: -1985235291706575900 Time: 0.112496 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:32] [V] [TRT] Tactic: -504296718212024303 Time: 0.11328 [05/21/2021-05:49:32] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.03844 [05/21/2021-05:49:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:32] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(25088,1:4,1792,128) *************** [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1373022415249282411 Time: 0.082592 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1663866669559596164 Time: 0.12316 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:32] [V] [TRT] Tactic: 2860655430572478466 Time: 0.069876 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:32] [V] [TRT] Tactic: 4474630279712975759 Time: 0.040704 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:32] [V] [TRT] Tactic: 4479823862704990365 Time: 0.04006 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:32] [V] [TRT] Tactic: 4696204239951173149 Time: 0.070912 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:32] [V] [TRT] Tactic: 5778138195697110003 Time: 0.121116 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:32] [V] [TRT] Tactic: 8918020581761223752 Time: 0.109492 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:49:32] [V] [TRT] Tactic: -7067026478815706014 Time: 0.08266 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:32] [V] [TRT] Tactic: -5905193483742532701 Time: 0.061436 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:32] [V] [TRT] Tactic: -4035591156787122265 Time: 0.039368 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:32] [V] [TRT] Tactic: -2809379259463049391 Time: 0.12228 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:32] [V] [TRT] Tactic: -1985235291706575900 Time: 0.11066 [05/21/2021-05:49:32] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:32] [V] [TRT] Tactic: -504296718212024303 Time: 0.112408 [05/21/2021-05:49:32] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.039368 [05/21/2021-05:49:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:32] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(100352,196,14,1) *************** [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:32] [V] [TRT] Tactic: 0 Time: 0.058244 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1 Time: 0.056864 [05/21/2021-05:49:32] [V] [TRT] Tactic: 2 Time: 0.1146 [05/21/2021-05:49:32] [V] [TRT] Tactic: 4 Time: 1.72923 [05/21/2021-05:49:32] [V] [TRT] Tactic: 5 Time: 0.381768 [05/21/2021-05:49:32] [V] [TRT] Tactic: 56 Time: 0.05824 [05/21/2021-05:49:32] [V] [TRT] Tactic: 58 Time: 0.115016 [05/21/2021-05:49:32] [V] [TRT] Tactic: 60 Time: 1.72924 [05/21/2021-05:49:32] [V] [TRT] Tactic: 61 Time: 0.382156 [05/21/2021-05:49:32] [V] [TRT] Fastest Tactic: 1 Time: 0.056864 [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:49:32] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196,14,1) *************** [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:32] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196:2,14,1) *************** [05/21/2021-05:49:32] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (FusedConvActConvolution) [05/21/2021-05:49:32] [V] [TRT] Tactic: 589823 Time: 0.111092 [05/21/2021-05:49:32] [V] [TRT] Tactic: 655359 Time: 0.080128 [05/21/2021-05:49:32] [V] [TRT] Tactic: 786431 Time: 0.030708 [05/21/2021-05:49:32] [V] [TRT] Tactic: 851967 Time: 0.02628 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1179647 Time: 0.020868 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1310719 Time: 0.057032 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1376255 Time: 0.082908 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1441791 Time: 0.019796 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1507327 Time: 0.045512 [05/21/2021-05:49:32] [V] [TRT] Tactic: 1638399 Time: 0.022444 [05/21/2021-05:49:33] [V] [TRT] Tactic: 1835007 Time: 0.030404 [05/21/2021-05:49:33] [V] [TRT] Tactic: 1900543 Time: 0.085064 [05/21/2021-05:49:33] [V] [TRT] Tactic: 2097151 Time: 0.018688 [05/21/2021-05:49:33] [V] [TRT] Tactic: 2162687 Time: 0.085168 [05/21/2021-05:49:33] [V] [TRT] Tactic: 2293759 Time: 0.073728 [05/21/2021-05:49:33] [V] [TRT] Tactic: 2359295 Time: 0.04608 [05/21/2021-05:49:33] [V] [TRT] Tactic: 2686975 Time: 0.075808 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3080191 Time: 0.039936 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3342335 Time: 0.045312 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3407871 Time: 0.043804 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3538943 Time: 0.024832 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3670015 Time: 0.153656 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3932159 Time: 0.064668 [05/21/2021-05:49:33] [V] [TRT] Tactic: 3997695 Time: 0.0224 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4063231 Time: 0.025344 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4194303 Time: 0.029592 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4259839 Time: 0.019436 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4325375 Time: 0.02368 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4521983 Time: 0.075148 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4587519 Time: 0.020352 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4653055 Time: 0.019244 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4915199 Time: 0.020736 [05/21/2021-05:49:33] [V] [TRT] Tactic: 4980735 Time: 0.038784 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5177343 Time: 0.021672 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5242879 Time: 0.037888 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5373951 Time: 0.021556 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5439487 Time: 0.029696 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5570559 Time: 0.044032 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5636095 Time: 0.025364 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5701631 Time: 0.071824 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5767167 Time: 0.042388 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5832703 Time: 0.041984 [05/21/2021-05:49:33] [V] [TRT] Tactic: 5898239 Time: 0.02048 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6029311 Time: 0.068788 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6225919 Time: 0.023552 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6291455 Time: 0.020992 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6422527 Time: 0.037024 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6750207 Time: 0.023296 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6815743 Time: 0.041608 [05/21/2021-05:49:33] [V] [TRT] Tactic: 6946815 Time: 0.031332 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7012351 Time: 0.018592 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7077887 Time: 0.024744 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7143423 Time: 0.04096 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7208959 Time: 0.042112 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7340031 Time: 0.020224 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7405567 Time: 0.02264 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7536639 Time: 0.062628 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7602175 Time: 0.032512 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7733247 Time: 0.027776 [05/21/2021-05:49:33] [V] [TRT] Tactic: 7798783 Time: 0.030844 [05/21/2021-05:49:33] [V] [TRT] Tactic: 8191999 Time: 0.030112 [05/21/2021-05:49:33] [V] [TRT] Tactic: 8257535 Time: 0.02176 [05/21/2021-05:49:33] [V] [TRT] Tactic: 8323071 Time: 0.028968 [05/21/2021-05:49:33] [V] [TRT] Tactic: 8650751 Time: 0.03008 [05/21/2021-05:49:34] [V] [TRT] Tactic: 8716287 Time: 0.02624 [05/21/2021-05:49:34] [V] [TRT] Tactic: 9109503 Time: 0.019296 [05/21/2021-05:49:34] [V] [TRT] Tactic: 9568255 Time: 0.02102 [05/21/2021-05:49:34] [V] [TRT] Tactic: 9895935 Time: 0.029584 [05/21/2021-05:49:34] [V] [TRT] Tactic: 10223615 Time: 0.07578 [05/21/2021-05:49:34] [V] [TRT] Tactic: 10354687 Time: 0.020492 [05/21/2021-05:49:34] [V] [TRT] Tactic: 10551295 Time: 0.0448 [05/21/2021-05:49:34] [V] [TRT] Tactic: 10747903 Time: 0.026624 [05/21/2021-05:49:34] [V] [TRT] Tactic: 10944511 Time: 0.038572 [05/21/2021-05:49:34] [V] [TRT] Fastest Tactic: 7012351 Time: 0.018592 [05/21/2021-05:49:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:34] [V] [TRT] Tactic: 2195670545862694453 Time: 0.054284 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:34] [V] [TRT] Tactic: 3891805945559659536 Time: 0.077312 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:34] [V] [TRT] Tactic: 4418200634486186714 Time: 0.045952 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:34] [V] [TRT] Tactic: 5548126322150286555 Time: 0.05108 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:34] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048904 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:34] [V] [TRT] Tactic: 7392644644614664811 Time: 0.04704 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:34] [V] [TRT] Tactic: -4884039206922900293 Time: 0.075656 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:34] [V] [TRT] Tactic: -4374269919094467161 Time: 0.049328 [05/21/2021-05:49:34] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:35] [V] [TRT] Tactic: -1546027692247304867 Time: 0.076916 [05/21/2021-05:49:35] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.045952 [05/21/2021-05:49:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351 [05/21/2021-05:49:35] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(100352,196,14,1) *************** [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:35] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:35] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(12544,1:8,896,64) *************** [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:49:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:35] [V] [TRT] Tactic: 0 Time: 0.081816 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1 Time: 0.06208 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2 Time: 0.113972 [05/21/2021-05:49:35] [V] [TRT] Tactic: 56 Time: 0.080944 [05/21/2021-05:49:35] [V] [TRT] Tactic: 58 Time: 0.108324 [05/21/2021-05:49:35] [V] [TRT] Fastest Tactic: 1 Time: 0.06208 [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:35] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:35] [V] [TRT] Tactic: 254850674756030979 Time: 0.042948 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1156328698016730421 Time: 0.026896 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1362727228442059924 Time: 0.027608 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1576319725282257846 Time: 0.015956 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1832046141070096030 Time: 0.016 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1838082074606840426 Time: 0.015368 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:35] [V] [TRT] Tactic: 1899296423087490472 Time: 0.010752 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2238656696610018305 Time: 0.014968 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2541579301352125276 Time: 0.025636 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2559328254295148085 Time: 0.041984 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011508 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:35] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0157 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010252 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3359475309458902373 Time: 0.015388 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3362537467505018070 Time: 0.024548 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3513075359009385578 Time: 0.043092 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3704534001553878387 Time: 0.025008 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:49:35] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009728 [05/21/2021-05:49:35] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4278315135102886928 Time: 0.014848 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4370476717970497892 Time: 0.014208 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4480294673430783793 Time: 0.01536 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0416 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4528997467275241200 Time: 0.02432 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4571819373777460444 Time: 0.042796 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4595173549602041350 Time: 0.041924 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4802447371470387646 Time: 0.026624 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:49:36] [V] [TRT] Tactic: 4993757826442493905 Time: 0.015024 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:36] [V] [TRT] Tactic: 5059676457552313631 Time: 0.041344 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:49:36] [V] [TRT] Tactic: 5205510332404400949 Time: 0.023552 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:49:36] [V] [TRT] Tactic: 5346855796032465921 Time: 0.023512 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:36] [V] [TRT] Tactic: 5398999388616959893 Time: 0.025828 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:36] [V] [TRT] Tactic: 6034364043891107501 Time: 0.014892 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:36] [V] [TRT] Tactic: 6377497238381488891 Time: 0.024448 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:36] [V] [TRT] Tactic: 6468794451065529747 Time: 0.016376 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:49:36] [V] [TRT] Tactic: 6697277555581639516 Time: 0.014916 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:36] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011264 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:36] [V] [TRT] Tactic: 7216571380637776659 Time: 0.029568 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:36] [V] [TRT] Tactic: 7609923741161019135 Time: 0.014824 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:36] [V] [TRT] Tactic: 8101703987960976805 Time: 0.011272 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:36] [V] [TRT] Tactic: 8170606396342855895 Time: 0.015672 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:49:36] [V] [TRT] Tactic: 8764780417487154889 Time: 0.025736 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:49:36] [V] [TRT] Tactic: 8823554289762712606 Time: 0.015332 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:36] [V] [TRT] Tactic: 8839784824303350101 Time: 0.027384 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:49:36] [V] [TRT] Tactic: -9203179519031456182 Time: 0.011744 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:36] [V] [TRT] Tactic: -9009272790678027912 Time: 0.028672 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:36] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011392 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:49:36] [V] [TRT] Tactic: -8280443484414412687 Time: 0.041908 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:49:36] [V] [TRT] Tactic: -8205952393017864204 Time: 0.041652 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:49:36] [V] [TRT] Tactic: -8131857373260504832 Time: 0.014324 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:49:36] [V] [TRT] Tactic: -7410012245391920273 Time: 0.011252 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:49:36] [V] [TRT] Tactic: -7099920365135295801 Time: 0.014976 [05/21/2021-05:49:36] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:49:37] [V] [TRT] Tactic: -7089118800560870395 Time: 0.011392 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:49:37] [V] [TRT] Tactic: -6768327495007644783 Time: 0.024376 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:37] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012288 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:37] [V] [TRT] Tactic: -6063766379489217211 Time: 0.01626 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:37] [V] [TRT] Tactic: -5530886555766748586 Time: 0.024788 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:49:37] [V] [TRT] Tactic: -5409588854490562130 Time: 0.011448 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:37] [V] [TRT] Tactic: -5161596964442251102 Time: 0.015856 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:37] [V] [TRT] Tactic: -5127240325355316006 Time: 0.015076 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4950923835688973492 Time: 0.010576 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4796511246675321840 Time: 0.015372 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4548822885169694805 Time: 0.010724 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4379519430184503304 Time: 0.014592 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4293222705763522367 Time: 0.010752 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4152066959007262150 Time: 0.043124 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:37] [V] [TRT] Tactic: -4021926646879732549 Time: 0.015524 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3987638434926559037 Time: 0.016128 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3905653247016903130 Time: 0.026476 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3903342530518878192 Time: 0.025308 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3864869056275745423 Time: 0.025856 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011192 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:37] [V] [TRT] Tactic: -3058330359340425555 Time: 0.015312 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:37] [V] [TRT] Tactic: -2878731503146438856 Time: 0.023132 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:37] [V] [TRT] Tactic: -2602982885923184927 Time: 0.024288 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:37] [V] [TRT] Tactic: -2353603993968373338 Time: 0.026536 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:37] [V] [TRT] Tactic: -2032577876140256150 Time: 0.016256 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:37] [V] [TRT] Tactic: -2003055242756584050 Time: 0.01472 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1985778916402815946 Time: 0.026916 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010268 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1640527254204634147 Time: 0.01536 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1562548049711204899 Time: 0.022724 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1242202084391243207 Time: 0.01472 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1099247066487349374 Time: 0.01088 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:37] [V] [TRT] Tactic: -1038291877007553549 Time: 0.01536 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:37] [V] [TRT] Tactic: -406984317033388136 Time: 0.025324 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:37] [V] [TRT] Tactic: -331499326992534460 Time: 0.014864 [05/21/2021-05:49:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:49:37] [V] [TRT] Tactic: -206523504474952360 Time: 0.024824 [05/21/2021-05:49:37] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.009728 [05/21/2021-05:49:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852 [05/21/2021-05:49:37] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(6272,1:16,448,32) *************** [05/21/2021-05:49:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution) [05/21/2021-05:49:38] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution) [05/21/2021-05:49:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution) [05/21/2021-05:49:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.010304 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005756 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005756 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.010372 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.00576 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.025732 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004148 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004148 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00754 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004332 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004332 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00706 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005888 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005888 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.011548 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.008064 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007172 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005128 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005128 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005124 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005124 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004468 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004468 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005108 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005108 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007492 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004668 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004668 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006476 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005812 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005812 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00758 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.00554 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00554 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006716 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005112 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.026652 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007148 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005596 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005596 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.006104 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006104 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.010236 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004116 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004116 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00832 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004368 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004368 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.008576 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005124 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005124 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00744 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004092 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004092 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006348 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004328 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004328 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.00452 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00452 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.010456 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.00428 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00428 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.005228 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005228 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.007624 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.004808 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004808 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:38] [V] [TRT] Tactic: 1002 Time: 0.006764 [05/21/2021-05:49:38] [V] [TRT] Tactic: 0 Time: 0.0052 [05/21/2021-05:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0052 [05/21/2021-05:49:38] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.00926 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.004232 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004232 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.007592 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(6272,1:16,448,32) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.006396 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.00444 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00444 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(100352,196,14,1) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.00688 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.005224 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005224 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(100352,1,7168,512) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.006016 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.004324 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004324 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(25088,1:4,1792,128) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.0053 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.0053 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(100352,196,14,1) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.005632 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005632 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(50176,196:2,14,1) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.005552 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005552 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(12544,1:8,896,64) (Reformat) [05/21/2021-05:49:39] [V] [TRT] Tactic: 1002 Time: 0.006944 [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:49:39] [V] [TRT] *************** Autotuning format combination: Float(100352,196,14,1) -> Float(25088,49,7,1) *************** [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:49:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:49:39] [V] [TRT] Tactic: 458751 Time: 0.328692 [05/21/2021-05:49:39] [V] [TRT] Fastest Tactic: 458751 Time: 0.328692 [05/21/2021-05:49:39] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:39] [V] [TRT] Tactic: 0 Time: 0.274124 [05/21/2021-05:49:39] [V] [TRT] Tactic: 1 Time: 0.093216 [05/21/2021-05:49:39] [V] [TRT] Tactic: 2 Time: 0.304164 [05/21/2021-05:49:39] [V] [TRT] Tactic: 5 Time: 3.2014 [05/21/2021-05:49:39] [V] [TRT] Tactic: 56 Time: 0.280116 [05/21/2021-05:49:39] [V] [TRT] Tactic: 57 Time: 0.092564 [05/21/2021-05:49:39] [V] [TRT] Tactic: 58 Time: 0.304064 [05/21/2021-05:49:39] [V] [TRT] Tactic: 61 Time: 3.19928 [05/21/2021-05:49:40] [V] [TRT] Tactic: 112 Time: 0.280064 [05/21/2021-05:49:40] [V] [TRT] Tactic: 113 Time: 0.278556 [05/21/2021-05:49:40] [V] [TRT] Tactic: 114 Time: 0.302908 [05/21/2021-05:49:40] [V] [TRT] Tactic: 117 Time: 2.9226 [05/21/2021-05:49:40] [V] [TRT] Fastest Tactic: 57 Time: 0.092564 [05/21/2021-05:49:40] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4549827808004681195 Time: 0.392916 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:40] [V] [TRT] Tactic: 5779835512569528575 Time: 0.495156 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:49:40] [V] [TRT] Tactic: 6053873026024413720 Time: 0.496384 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:49:40] [V] [TRT] Tactic: 6767548733843469815 Time: 0.400128 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:40] [V] [TRT] Tactic: -6313876406580483184 Time: 0.58562 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:40] [V] [TRT] Tactic: -1123676555321336786 Time: 0.490348 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:40] [V] [TRT] Tactic: -701551393537224327 Time: 0.422656 [05/21/2021-05:49:40] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.392916 [05/21/2021-05:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 57 [05/21/2021-05:49:40] [V] [TRT] *************** Autotuning format combination: Float(100352,1,7168,512) -> Float(25088,1,3584,512) *************** [05/21/2021-05:49:40] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:40] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:40] [V] [TRT] Tactic: 2860655430572478466 Time: 0.285796 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4474630279712975759 Time: 0.153652 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4479823862704990365 Time: 0.151924 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4696204239951173149 Time: 0.28672 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:40] [V] [TRT] Tactic: 5778138195697110003 Time: 0.491392 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:49:40] [V] [TRT] Tactic: 7155825427510256858 Time: 0.481364 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:40] [V] [TRT] Tactic: 8918020581761223752 Time: 0.473088 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:49:40] [V] [TRT] Tactic: -4756382386362004279 Time: 0.280828 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:49:40] [V] [TRT] Tactic: -3855385237722507464 Time: 0.49462 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:40] [V] [TRT] Tactic: -2809379259463049391 Time: 0.48424 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:40] [V] [TRT] Tactic: -504296718212024303 Time: 0.475136 [05/21/2021-05:49:40] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.151924 [05/21/2021-05:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:49:40] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,1792,128) -> Float(6272,1:4,896,128) *************** [05/21/2021-05:49:40] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:40] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:40] [V] [TRT] Tactic: 2860655430572478466 Time: 0.28584 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4474630279712975759 Time: 0.154384 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4479823862704990365 Time: 0.152272 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:40] [V] [TRT] Tactic: 4696204239951173149 Time: 0.2861 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:40] [V] [TRT] Tactic: 5778138195697110003 Time: 0.49088 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:49:40] [V] [TRT] Tactic: 7155825427510256858 Time: 0.481536 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:49:40] [V] [TRT] Tactic: 7342025736444949634 Time: 0.332992 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:40] [V] [TRT] Tactic: 8918020581761223752 Time: 0.473 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:49:40] [V] [TRT] Tactic: -7377458734869418330 Time: 0.326016 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:49:40] [V] [TRT] Tactic: -5457304872213719461 Time: 0.32978 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:49:40] [V] [TRT] Tactic: -4756382386362004279 Time: 0.28114 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:49:40] [V] [TRT] Tactic: -3855385237722507464 Time: 0.494336 [05/21/2021-05:49:40] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:41] [V] [TRT] Tactic: -2809379259463049391 Time: 0.484376 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:41] [V] [TRT] Tactic: -504296718212024303 Time: 0.47522 [05/21/2021-05:49:41] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.152272 [05/21/2021-05:49:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:49:41] [V] [TRT] *************** Autotuning format combination: Half(100352,196,14,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:41] [V] [TRT] Tactic: 0 Time: 0.31296 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1 Time: 0.3133 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2 Time: 0.180076 [05/21/2021-05:49:41] [V] [TRT] Tactic: 5 Time: 2.87146 [05/21/2021-05:49:41] [V] [TRT] Tactic: 56 Time: 0.219556 [05/21/2021-05:49:41] [V] [TRT] Tactic: 58 Time: 0.246272 [05/21/2021-05:49:41] [V] [TRT] Tactic: 61 Time: 3.14814 [05/21/2021-05:49:41] [V] [TRT] Fastest Tactic: 2 Time: 0.180076 [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [05/21/2021-05:49:41] [V] [TRT] *************** Autotuning format combination: Half(50176,196:2,14,1) -> Half(12544,49:2,7,1) *************** [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (FusedConvActConvolution) [05/21/2021-05:49:41] [V] [TRT] Tactic: 458751 Time: 0.19246 [05/21/2021-05:49:41] [V] [TRT] Fastest Tactic: 458751 Time: 0.19246 [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2195670545862694453 Time: 0.255536 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:49:41] [V] [TRT] Tactic: 3419182076704469245 Time: 0.223488 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:41] [V] [TRT] Tactic: 3891805945559659536 Time: 0.314424 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:41] [V] [TRT] Tactic: 5548126322150286555 Time: 0.21068 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:41] [V] [TRT] Tactic: 6057304366605292508 Time: 0.192324 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:49:41] [V] [TRT] Tactic: -7928611605886347652 Time: 0.327192 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:49:41] [V] [TRT] Tactic: -5172391392092686714 Time: 0.24156 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:41] [V] [TRT] Tactic: -4374269919094467161 Time: 0.214264 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:41] [V] [TRT] Tactic: -1546027692247304867 Time: 0.322664 [05/21/2021-05:49:41] [V] [TRT] Fastest Tactic: 6057304366605292508 Time: 0.192324 [05/21/2021-05:49:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6057304366605292508 [05/21/2021-05:49:41] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,896,64) -> Float(25088,49,7,1) *************** [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:41] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,896,64) -> Half(3136,1:8,448,64) *************** [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:49:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:41] [V] [TRT] Tactic: 0 Time: 0.275208 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1 Time: 0.275584 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2 Time: 0.240384 [05/21/2021-05:49:41] [V] [TRT] Tactic: 56 Time: 0.2752 [05/21/2021-05:49:41] [V] [TRT] Tactic: 58 Time: 0.240512 [05/21/2021-05:49:41] [V] [TRT] Fastest Tactic: 2 Time: 0.240384 [05/21/2021-05:49:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:41] [V] [TRT] Tactic: 254850674756030979 Time: 0.163272 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:49:41] [V] [TRT] Tactic: 328038211831149625 Time: 0.160336 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:49:41] [V] [TRT] Tactic: 411553864378931917 Time: 0.045432 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1011057357468998345 Time: 0.0908 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1156328698016730421 Time: 0.09522 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1723736032573714698 Time: 0.04416 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1832046141070096030 Time: 0.045444 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1838082074606840426 Time: 0.046104 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:41] [V] [TRT] Tactic: 1899296423087490472 Time: 0.026848 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2428167804343994714 Time: 0.0476 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2541579301352125276 Time: 0.09222 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2657157263811141609 Time: 0.027132 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:49:41] [V] [TRT] Tactic: 2819719497590964443 Time: 0.046924 [05/21/2021-05:49:41] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:42] [V] [TRT] Tactic: 2968605903460894194 Time: 0.045952 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:49:42] [V] [TRT] Tactic: 2986078304285316765 Time: 0.09466 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:42] [V] [TRT] Tactic: 3362537467505018070 Time: 0.084032 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:42] [V] [TRT] Tactic: 3513075359009385578 Time: 0.164892 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:49:42] [V] [TRT] Tactic: 3573559043797674382 Time: 0.046236 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:49:42] [V] [TRT] Tactic: 3591970081995419777 Time: 0.024576 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:42] [V] [TRT] Tactic: 3704534001553878387 Time: 0.088596 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:42] [V] [TRT] Tactic: 4278315135102886928 Time: 0.045956 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:49:42] [V] [TRT] Tactic: 4503233883285355107 Time: 0.034688 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:42] [V] [TRT] Tactic: 4802447371470387646 Time: 0.099648 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5059676457552313631 Time: 0.162132 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5368829646735632944 Time: 0.028712 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5398999388616959893 Time: 0.089008 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5746691132547383910 Time: 0.046468 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5770170567977052602 Time: 0.101376 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:49:42] [V] [TRT] Tactic: 5953552212833506549 Time: 0.083948 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6034364043891107501 Time: 0.045952 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6074229447555668232 Time: 0.027676 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6154447660803990543 Time: 0.044544 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6325769668000961702 Time: 0.084104 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6350273239113254096 Time: 0.020608 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0839 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6446388116965632819 Time: 0.046884 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6468794451065529747 Time: 0.046044 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6642277870194067185 Time: 0.168108 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6859477213531075460 Time: 0.027544 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6972489290272968208 Time: 0.082684 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:49:42] [V] [TRT] Tactic: 6979044990896381511 Time: 0.15872 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:42] [V] [TRT] Tactic: 7216571380637776659 Time: 0.106148 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:42] [V] [TRT] Tactic: 7609923741161019135 Time: 0.045048 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:49:42] [V] [TRT] Tactic: 7705739241028240201 Time: 0.029412 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:49:42] [V] [TRT] Tactic: 8072087735545283117 Time: 0.164696 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:42] [V] [TRT] Tactic: 8101703987960976805 Time: 0.029176 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:42] [V] [TRT] Tactic: 8170606396342855895 Time: 0.046084 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:42] [V] [TRT] Tactic: 8839784824303350101 Time: 0.10652 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:49:42] [V] [TRT] Tactic: -9217371357561775773 Time: 0.029056 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:42] [V] [TRT] Tactic: -9009272790678027912 Time: 0.108144 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:49:42] [V] [TRT] Tactic: -8985224497679592364 Time: 0.034744 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:49:42] [V] [TRT] Tactic: -8949544755481315679 Time: 0.046492 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:49:42] [V] [TRT] Tactic: -8759929675070720385 Time: 0.083328 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:42] [V] [TRT] Tactic: -8604374562669615024 Time: 0.026744 [05/21/2021-05:49:42] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6902925267326201166 Time: 0.02044 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6840588038605932325 Time: 0.045068 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6799856376604253964 Time: 0.16064 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6625722781282978136 Time: 0.045868 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6525498856028268801 Time: 0.086296 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6356316196810535311 Time: 0.029468 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6324345858751792783 Time: 0.04636 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6262400699544994312 Time: 0.160256 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6257787336162086472 Time: 0.097152 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:43] [V] [TRT] Tactic: -6063766379489217211 Time: 0.046124 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5777580938094193096 Time: 0.04804 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5657273398217409378 Time: 0.163328 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5530886555766748586 Time: 0.08268 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5422685219138380548 Time: 0.044288 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5161596964442251102 Time: 0.044908 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:43] [V] [TRT] Tactic: -5127240325355316006 Time: 0.04536 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4825567853927730435 Time: 0.045344 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4796511246675321840 Time: 0.046304 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4706569565442112734 Time: 0.029308 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4566599693570369588 Time: 0.084328 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4409144516525410768 Time: 0.083996 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4379519430184503304 Time: 0.045812 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4152066959007262150 Time: 0.16384 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:43] [V] [TRT] Tactic: -4021926646879732549 Time: 0.044416 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3987638434926559037 Time: 0.045208 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3905653247016903130 Time: 0.08982 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3903974568488493144 Time: 0.05274 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3895429239811098010 Time: 0.045676 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3864869056275745423 Time: 0.094488 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3601464762214218301 Time: 0.027136 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3412636942650049698 Time: 0.091648 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3338665856053412950 Time: 0.084288 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:43] [V] [TRT] Tactic: -3058330359340425555 Time: 0.045848 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:49:43] [V] [TRT] Tactic: -2816084650627734155 Time: 0.094592 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:49:43] [V] [TRT] Tactic: -2662892962457732243 Time: 0.045568 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:49:43] [V] [TRT] Tactic: -2559894581585337900 Time: 0.162444 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:49:43] [V] [TRT] Tactic: -2530740716768816092 Time: 0.081664 [05/21/2021-05:49:43] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:49:44] [V] [TRT] Tactic: -2332828394978346992 Time: 0.085028 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:49:44] [V] [TRT] Tactic: -2241736083352441442 Time: 0.115072 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:49:44] [V] [TRT] Tactic: -2161909437867201546 Time: 0.025736 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:44] [V] [TRT] Tactic: -1985778916402815946 Time: 0.099228 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:49:44] [V] [TRT] Tactic: -1500496213132463076 Time: 0.047232 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:44] [V] [TRT] Tactic: -1099247066487349374 Time: 0.026388 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:49:44] [V] [TRT] Tactic: -910286698936744682 Time: 0.024576 [05/21/2021-05:49:44] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:49:44] [V] [TRT] Tactic: -606726295133751039 Time: 0.047104 [05/21/2021-05:49:44] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.02044 [05/21/2021-05:49:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166 [05/21/2021-05:49:44] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,448,32) -> Half(1568,1:16,224,32) *************** [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution) [05/21/2021-05:49:44] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution) [05/21/2021-05:49:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:44] [V] [TRT] Tactic: 1002 Time: 0.0111 [05/21/2021-05:49:44] [V] [TRT] Tactic: 0 Time: 0.004848 [05/21/2021-05:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004848 [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:44] [V] [TRT] Tactic: 1002 Time: 0.011136 [05/21/2021-05:49:44] [V] [TRT] Tactic: 0 Time: 0.00486 [05/21/2021-05:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:44] [V] [TRT] Tactic: 1002 Time: 0.011404 [05/21/2021-05:49:44] [V] [TRT] Tactic: 0 Time: 0.003972 [05/21/2021-05:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003972 [05/21/2021-05:49:44] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:44] [V] [TRT] Tactic: 1002 Time: 0.007696 [05/21/2021-05:49:44] [V] [TRT] Tactic: 0 Time: 0.00384 [05/21/2021-05:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.0043 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0043 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004156 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004156 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.01024 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004084 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.007928 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004388 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004388 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.007156 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004688 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004688 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.00726 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006376 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004452 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004452 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006456 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.00432 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00432 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.011648 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.00482 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00482 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.00776 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004712 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004712 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.00618 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004212 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004212 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.0041 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0041 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.00512 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004528 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004528 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.004424 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004424 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:45] [V] [TRT] Tactic: 1002 Time: 0.011912 [05/21/2021-05:49:45] [V] [TRT] Tactic: 0 Time: 0.003584 [05/21/2021-05:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [05/21/2021-05:49:45] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.005 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.005 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007532 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004664 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004664 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.009264 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.003584 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.003584 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.008704 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.0087 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004132 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004132 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.003404 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.003404 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006304 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.00408 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00408 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004072 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004072 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.010624 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.003664 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.003664 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007352 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.00384 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007432 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.00446 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00446 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.00734 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004348 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004348 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004552 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004552 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.00426 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00426 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.008348 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004072 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004072 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(1568,1:16,224,32) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.005504 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004908 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004908 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004608 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004608 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(25088,1,3584,512) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006356 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004584 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004584 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(6272,1:4,896,128) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004268 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004268 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(25088,49,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.00846 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004788 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004788 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(12544,49:2,7,1) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.007344 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004704 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004704 [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(3136,1:8,448,64) (Reformat) [05/21/2021-05:49:46] [V] [TRT] Tactic: 1002 Time: 0.0065 [05/21/2021-05:49:46] [V] [TRT] Tactic: 0 Time: 0.004328 [05/21/2021-05:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004328 [05/21/2021-05:49:46] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:49:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:46] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:49:46] [V] [TRT] Tactic: 589823 Time: 0.108544 [05/21/2021-05:49:46] [V] [TRT] Tactic: 655359 Time: 0.069632 [05/21/2021-05:49:46] [V] [TRT] Tactic: 786431 Time: 0.040504 [05/21/2021-05:49:46] [V] [TRT] Tactic: 851967 Time: 0.035652 [05/21/2021-05:49:46] [V] [TRT] Tactic: 1179647 Time: 0.02368 [05/21/2021-05:49:46] [V] [TRT] Tactic: 1310719 Time: 0.071296 [05/21/2021-05:49:46] [V] [TRT] Tactic: 1376255 Time: 0.110464 [05/21/2021-05:49:47] [V] [TRT] Tactic: 1441791 Time: 0.035016 [05/21/2021-05:49:47] [V] [TRT] Tactic: 1507327 Time: 0.060684 [05/21/2021-05:49:47] [V] [TRT] Tactic: 1638399 Time: 0.033244 [05/21/2021-05:49:47] [V] [TRT] Tactic: 1835007 Time: 0.034084 [05/21/2021-05:49:47] [V] [TRT] Tactic: 1900543 Time: 0.074752 [05/21/2021-05:49:47] [V] [TRT] Tactic: 2097151 Time: 0.01792 [05/21/2021-05:49:47] [V] [TRT] Tactic: 2162687 Time: 0.112 [05/21/2021-05:49:47] [V] [TRT] Tactic: 2293759 Time: 0.104788 [05/21/2021-05:49:47] [V] [TRT] Tactic: 2359295 Time: 0.062672 [05/21/2021-05:49:47] [V] [TRT] Tactic: 2686975 Time: 0.10718 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3080191 Time: 0.056992 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3342335 Time: 0.061572 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3407871 Time: 0.058024 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3538943 Time: 0.027672 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3670015 Time: 0.133824 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3932159 Time: 0.059956 [05/21/2021-05:49:47] [V] [TRT] Tactic: 3997695 Time: 0.027668 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4063231 Time: 0.035176 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4194303 Time: 0.04212 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4259839 Time: 0.01984 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4325375 Time: 0.036096 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4521983 Time: 0.10734 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4587519 Time: 0.026884 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4653055 Time: 0.023828 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4915199 Time: 0.025612 [05/21/2021-05:49:47] [V] [TRT] Tactic: 4980735 Time: 0.041984 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5177343 Time: 0.021596 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5242879 Time: 0.03584 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5373951 Time: 0.024964 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5439487 Time: 0.039424 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5570559 Time: 0.060116 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5636095 Time: 0.034744 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5701631 Time: 0.104016 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5767167 Time: 0.060228 [05/21/2021-05:49:47] [V] [TRT] Tactic: 5832703 Time: 0.058372 [05/21/2021-05:49:48] [V] [TRT] Tactic: 5898239 Time: 0.02368 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6029311 Time: 0.064664 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6225919 Time: 0.025856 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6291455 Time: 0.024072 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6422527 Time: 0.056192 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6750207 Time: 0.024748 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6815743 Time: 0.059392 [05/21/2021-05:49:48] [V] [TRT] Tactic: 6946815 Time: 0.038912 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7012351 Time: 0.018836 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7077887 Time: 0.035672 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7143423 Time: 0.058668 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7208959 Time: 0.039296 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7340031 Time: 0.019456 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7405567 Time: 0.022552 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7536639 Time: 0.097088 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7602175 Time: 0.03776 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7733247 Time: 0.037504 [05/21/2021-05:49:48] [V] [TRT] Tactic: 7798783 Time: 0.040168 [05/21/2021-05:49:48] [V] [TRT] Tactic: 8191999 Time: 0.035328 [05/21/2021-05:49:48] [V] [TRT] Tactic: 8257535 Time: 0.026312 [05/21/2021-05:49:48] [V] [TRT] Tactic: 8323071 Time: 0.0384 [05/21/2021-05:49:48] [V] [TRT] Tactic: 8650751 Time: 0.038152 [05/21/2021-05:49:48] [V] [TRT] Tactic: 8716287 Time: 0.026812 [05/21/2021-05:49:48] [V] [TRT] Tactic: 9109503 Time: 0.01792 [05/21/2021-05:49:48] [V] [TRT] Tactic: 9568255 Time: 0.02176 [05/21/2021-05:49:48] [V] [TRT] Tactic: 9895935 Time: 0.042544 [05/21/2021-05:49:48] [V] [TRT] Tactic: 10223615 Time: 0.106912 [05/21/2021-05:49:48] [V] [TRT] Tactic: 10354687 Time: 0.025728 [05/21/2021-05:49:48] [V] [TRT] Tactic: 10551295 Time: 0.061568 [05/21/2021-05:49:48] [V] [TRT] Tactic: 10747903 Time: 0.036128 [05/21/2021-05:49:48] [V] [TRT] Tactic: 10944511 Time: 0.059268 [05/21/2021-05:49:48] [V] [TRT] Fastest Tactic: 2097151 Time: 0.01792 [05/21/2021-05:49:48] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:48] [V] [TRT] Tactic: 0 Time: 0.039112 [05/21/2021-05:49:48] [V] [TRT] Tactic: 1 Time: 0.032884 [05/21/2021-05:49:48] [V] [TRT] Tactic: 2 Time: 0.132136 [05/21/2021-05:49:49] [V] [TRT] Tactic: 4 Time: 3.82342 [05/21/2021-05:49:49] [V] [TRT] Tactic: 5 Time: 0.689492 [05/21/2021-05:49:49] [V] [TRT] Tactic: 56 Time: 0.026752 [05/21/2021-05:49:49] [V] [TRT] Tactic: 57 Time: 0.024576 [05/21/2021-05:49:49] [V] [TRT] Tactic: 58 Time: 0.082996 [05/21/2021-05:49:49] [V] [TRT] Tactic: 60 Time: 3.52274 [05/21/2021-05:49:49] [V] [TRT] Tactic: 61 Time: 0.670044 [05/21/2021-05:49:49] [V] [TRT] Tactic: 112 Time: 0.039268 [05/21/2021-05:49:49] [V] [TRT] Tactic: 113 Time: 0.03304 [05/21/2021-05:49:49] [V] [TRT] Tactic: 114 Time: 0.132976 [05/21/2021-05:49:49] [V] [TRT] Tactic: 116 Time: 3.84773 [05/21/2021-05:49:49] [V] [TRT] Tactic: 117 Time: 0.690292 [05/21/2021-05:49:49] [V] [TRT] Fastest Tactic: 57 Time: 0.024576 [05/21/2021-05:49:49] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:49] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:49] [V] [TRT] Tactic: 4549827808004681195 Time: 0.051968 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:49] [V] [TRT] Tactic: 5779835512569528575 Time: 0.063068 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:49] [V] [TRT] Tactic: 9151672657204310840 Time: 0.074132 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:49] [V] [TRT] Tactic: -7491730084094677098 Time: 0.060288 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:49:49] [V] [TRT] Tactic: -6622064180404051845 Time: 0.071552 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:49] [V] [TRT] Tactic: -6313876406580483184 Time: 0.082348 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:49] [V] [TRT] Tactic: -6273689210331812572 Time: 0.062244 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:49] [V] [TRT] Tactic: -4337126844824617177 Time: 0.04868 [05/21/2021-05:49:49] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:49] [V] [TRT] Tactic: -1123676555321336786 Time: 0.061184 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:50] [V] [TRT] Tactic: -701551393537224327 Time: 0.051188 [05/21/2021-05:49:50] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.04868 [05/21/2021-05:49:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [05/21/2021-05:49:50] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06264 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:50] [V] [TRT] Tactic: 2860655430572478466 Time: 0.039296 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024264 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024352 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4696204239951173149 Time: 0.038812 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:50] [V] [TRT] Tactic: 5778138195697110003 Time: 0.062416 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:50] [V] [TRT] Tactic: 8918020581761223752 Time: 0.060292 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:50] [V] [TRT] Tactic: -5905193483742532701 Time: 0.033792 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:50] [V] [TRT] Tactic: -4035591156787122265 Time: 0.02252 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:50] [V] [TRT] Tactic: -2809379259463049391 Time: 0.060288 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:50] [V] [TRT] Tactic: -1985235291706575900 Time: 0.060456 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:50] [V] [TRT] Tactic: -504296718212024303 Time: 0.060988 [05/21/2021-05:49:50] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.02252 [05/21/2021-05:49:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:50] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:50] [V] [TRT] Tactic: 1373022415249282411 Time: 0.048148 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06168 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:50] [V] [TRT] Tactic: 2860655430572478466 Time: 0.039192 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024528 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024352 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4696204239951173149 Time: 0.038528 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:50] [V] [TRT] Tactic: 5778138195697110003 Time: 0.060716 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:50] [V] [TRT] Tactic: 8918020581761223752 Time: 0.058356 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:49:50] [V] [TRT] Tactic: -7067026478815706014 Time: 0.047724 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:50] [V] [TRT] Tactic: -5905193483742532701 Time: 0.035328 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:50] [V] [TRT] Tactic: -4035591156787122265 Time: 0.02382 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:50] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0617 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:50] [V] [TRT] Tactic: -1985235291706575900 Time: 0.06016 [05/21/2021-05:49:50] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:50] [V] [TRT] Tactic: -504296718212024303 Time: 0.0608 [05/21/2021-05:49:50] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.02382 [05/21/2021-05:49:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:50] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:49:50] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:50] [V] [TRT] Tactic: 0 Time: 0.03086 [05/21/2021-05:49:50] [V] [TRT] Tactic: 1 Time: 0.030568 [05/21/2021-05:49:50] [V] [TRT] Tactic: 2 Time: 0.084872 [05/21/2021-05:49:50] [V] [TRT] Tactic: 4 Time: 3.5641 [05/21/2021-05:49:50] [V] [TRT] Tactic: 5 Time: 0.63168 [05/21/2021-05:49:51] [V] [TRT] Tactic: 56 Time: 0.032328 [05/21/2021-05:49:51] [V] [TRT] Tactic: 58 Time: 0.090112 [05/21/2021-05:49:51] [V] [TRT] Tactic: 60 Time: 3.8479 [05/21/2021-05:49:51] [V] [TRT] Tactic: 61 Time: 0.645656 [05/21/2021-05:49:51] [V] [TRT] Fastest Tactic: 1 Time: 0.030568 [05/21/2021-05:49:51] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:51] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:49:51] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:49:51] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:51] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:49:51] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (FusedConvActConvolution) [05/21/2021-05:49:51] [V] [TRT] Tactic: 589823 Time: 0.059364 [05/21/2021-05:49:51] [V] [TRT] Tactic: 655359 Time: 0.042796 [05/21/2021-05:49:51] [V] [TRT] Tactic: 786431 Time: 0.020148 [05/21/2021-05:49:51] [V] [TRT] Tactic: 851967 Time: 0.017408 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1179647 Time: 0.0137 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1310719 Time: 0.031616 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1376255 Time: 0.044032 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1441791 Time: 0.017408 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1507327 Time: 0.0256 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1638399 Time: 0.017588 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1835007 Time: 0.0192 [05/21/2021-05:49:51] [V] [TRT] Tactic: 1900543 Time: 0.045836 [05/21/2021-05:49:51] [V] [TRT] Tactic: 2097151 Time: 0.01228 [05/21/2021-05:49:51] [V] [TRT] Tactic: 2162687 Time: 0.045724 [05/21/2021-05:49:51] [V] [TRT] Tactic: 2293759 Time: 0.040192 [05/21/2021-05:49:51] [V] [TRT] Tactic: 2359295 Time: 0.026304 [05/21/2021-05:49:51] [V] [TRT] Tactic: 2686975 Time: 0.041452 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3080191 Time: 0.023128 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3342335 Time: 0.026112 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3407871 Time: 0.022784 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3538943 Time: 0.01574 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3670015 Time: 0.07986 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3932159 Time: 0.034304 [05/21/2021-05:49:51] [V] [TRT] Tactic: 3997695 Time: 0.017672 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4063231 Time: 0.016512 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4194303 Time: 0.017408 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4259839 Time: 0.013228 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4325375 Time: 0.017024 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4521983 Time: 0.041772 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4587519 Time: 0.015104 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4653055 Time: 0.016272 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4915199 Time: 0.01344 [05/21/2021-05:49:51] [V] [TRT] Tactic: 4980735 Time: 0.023552 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5177343 Time: 0.013452 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5242879 Time: 0.021632 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5373951 Time: 0.013824 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5439487 Time: 0.016896 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5570559 Time: 0.024576 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5636095 Time: 0.016384 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5701631 Time: 0.037916 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5767167 Time: 0.022528 [05/21/2021-05:49:51] [V] [TRT] Tactic: 5832703 Time: 0.023544 [05/21/2021-05:49:52] [V] [TRT] Tactic: 5898239 Time: 0.013476 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6029311 Time: 0.037504 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6225919 Time: 0.015236 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6291455 Time: 0.013576 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6422527 Time: 0.021632 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6750207 Time: 0.014336 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6815743 Time: 0.02364 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6946815 Time: 0.018028 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7012351 Time: 0.012324 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7077887 Time: 0.015872 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7143423 Time: 0.022068 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7208959 Time: 0.02356 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7340031 Time: 0.013312 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7405567 Time: 0.015908 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7536639 Time: 0.03302 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7602175 Time: 0.017664 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7733247 Time: 0.016884 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7798783 Time: 0.020008 [05/21/2021-05:49:52] [V] [TRT] Tactic: 8191999 Time: 0.01632 [05/21/2021-05:49:52] [V] [TRT] Tactic: 8257535 Time: 0.01372 [05/21/2021-05:49:52] [V] [TRT] Tactic: 8323071 Time: 0.017128 [05/21/2021-05:49:52] [V] [TRT] Tactic: 8650751 Time: 0.018048 [05/21/2021-05:49:52] [V] [TRT] Tactic: 8716287 Time: 0.016256 [05/21/2021-05:49:52] [V] [TRT] Tactic: 9109503 Time: 0.012292 [05/21/2021-05:49:52] [V] [TRT] Tactic: 9568255 Time: 0.013316 [05/21/2021-05:49:52] [V] [TRT] Tactic: 9895935 Time: 0.017792 [05/21/2021-05:49:52] [V] [TRT] Tactic: 10223615 Time: 0.04138 [05/21/2021-05:49:52] [V] [TRT] Tactic: 10354687 Time: 0.013312 [05/21/2021-05:49:52] [V] [TRT] Tactic: 10551295 Time: 0.024448 [05/21/2021-05:49:52] [V] [TRT] Tactic: 10747903 Time: 0.015504 [05/21/2021-05:49:52] [V] [TRT] Tactic: 10944511 Time: 0.023168 [05/21/2021-05:49:52] [V] [TRT] Fastest Tactic: 2097151 Time: 0.01228 [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:52] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:52] [V] [TRT] Tactic: 2195670545862694453 Time: 0.031232 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:52] [V] [TRT] Tactic: 3891805945559659536 Time: 0.042524 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:52] [V] [TRT] Tactic: 4418200634486186714 Time: 0.026956 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:52] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029224 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:52] [V] [TRT] Tactic: 6057304366605292508 Time: 0.028288 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:52] [V] [TRT] Tactic: 7392644644614664811 Time: 0.02758 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:52] [V] [TRT] Tactic: -4884039206922900293 Time: 0.041472 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:52] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028516 [05/21/2021-05:49:52] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:52] [V] [TRT] Tactic: -1546027692247304867 Time: 0.041084 [05/21/2021-05:49:52] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.026956 [05/21/2021-05:49:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [05/21/2021-05:49:52] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(100352,49,7,1) *************** [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:52] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudaDepthwiseConvolution) [05/21/2021-05:49:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:52] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:52] [V] [TRT] Tactic: 0 Time: 0.581428 [05/21/2021-05:49:52] [V] [TRT] Tactic: 1 Time: 0.054644 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2 Time: 0.072168 [05/21/2021-05:49:53] [V] [TRT] Tactic: 56 Time: 0.581208 [05/21/2021-05:49:53] [V] [TRT] Tactic: 58 Time: 0.0736 [05/21/2021-05:49:53] [V] [TRT] Fastest Tactic: 1 Time: 0.054644 [05/21/2021-05:49:53] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:53] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:53] [V] [TRT] Tactic: 254850674756030979 Time: 0.024928 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01656 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1362727228442059924 Time: 0.016768 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011392 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011136 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1838082074606840426 Time: 0.010368 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:53] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008192 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2238656696610018305 Time: 0.01024 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2541579301352125276 Time: 0.015488 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025024 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009224 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:49:53] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011256 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3071479995783211391 Time: 0.008268 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011296 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3362537467505018070 Time: 0.015484 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3513075359009385578 Time: 0.025216 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016036 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:49:53] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007288 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4278315135102886928 Time: 0.010224 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4370476717970497892 Time: 0.009812 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009268 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4491683531415781597 Time: 0.024988 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4528997467275241200 Time: 0.015856 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4571819373777460444 Time: 0.024676 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4595173549602041350 Time: 0.024932 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4802447371470387646 Time: 0.016248 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:49:53] [V] [TRT] Tactic: 4993757826442493905 Time: 0.010584 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:49:53] [V] [TRT] Tactic: 5059676457552313631 Time: 0.024816 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:49:53] [V] [TRT] Tactic: 5205510332404400949 Time: 0.01536 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:49:53] [V] [TRT] Tactic: 5346855796032465921 Time: 0.015092 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:49:53] [V] [TRT] Tactic: 5398999388616959893 Time: 0.015476 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:49:53] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0096 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:49:53] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01484 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:49:53] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011588 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:49:53] [V] [TRT] Tactic: 6697277555581639516 Time: 0.010752 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:49:53] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008428 [05/21/2021-05:49:53] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:49:54] [V] [TRT] Tactic: 7216571380637776659 Time: 0.017896 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:49:54] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010912 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:49:54] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008512 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:49:54] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011008 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:49:54] [V] [TRT] Tactic: 8764780417487154889 Time: 0.015668 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:49:54] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010112 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:49:54] [V] [TRT] Tactic: 8839784824303350101 Time: 0.016512 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:49:54] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00896 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:49:54] [V] [TRT] Tactic: -9009272790678027912 Time: 0.017348 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:49:54] [V] [TRT] Tactic: -8604374562669615024 Time: 0.008832 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:49:54] [V] [TRT] Tactic: -8280443484414412687 Time: 0.02454 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:49:54] [V] [TRT] Tactic: -8205952393017864204 Time: 0.024844 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:49:54] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011412 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:49:54] [V] [TRT] Tactic: -7410012245391920273 Time: 0.009132 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:49:54] [V] [TRT] Tactic: -7099920365135295801 Time: 0.010728 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:49:54] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00818 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:49:54] [V] [TRT] Tactic: -6768327495007644783 Time: 0.016128 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:49:54] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009728 [05/21/2021-05:49:54] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:49:55] [V] [TRT] Tactic: -6063766379489217211 Time: 0.012304 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:49:55] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016256 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:49:55] [V] [TRT] Tactic: -5409588854490562130 Time: 0.010908 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:49:55] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011264 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:49:55] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01048 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:49:55] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008576 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:49:55] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011472 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:49:55] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00896 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:49:55] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010352 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:49:55] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00782 [05/21/2021-05:49:55] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:49:56] [V] [TRT] Tactic: -4152066959007262150 Time: 0.024576 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:49:56] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011284 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011648 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3905653247016903130 Time: 0.016956 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3903342530518878192 Time: 0.015916 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0161 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00832 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:49:56] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011292 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:49:56] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016256 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:49:56] [V] [TRT] Tactic: -2602982885923184927 Time: 0.015388 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:49:56] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01536 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:49:56] [V] [TRT] Tactic: -2032577876140256150 Time: 0.010612 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:49:56] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00996 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1985778916402815946 Time: 0.015808 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00818 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1640527254204634147 Time: 0.01088 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1562548049711204899 Time: 0.016272 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1242202084391243207 Time: 0.010588 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0088 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:49:56] [V] [TRT] Tactic: -1038291877007553549 Time: 0.010664 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:49:56] [V] [TRT] Tactic: -406984317033388136 Time: 0.015356 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:49:56] [V] [TRT] Tactic: -331499326992534460 Time: 0.009472 [05/21/2021-05:49:56] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:49:56] [V] [TRT] Tactic: -206523504474952360 Time: 0.014988 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.007288 [05/21/2021-05:49:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852 [05/21/2021-05:49:56] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution) [05/21/2021-05:49:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution) [05/21/2021-05:49:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution) [05/21/2021-05:49:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.011092 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.005676 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005676 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.010696 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.006048 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.006048 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.029744 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.00464 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00464 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.008112 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.007288 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004236 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004236 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.007208 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.005744 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005744 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.011444 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.008076 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004808 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004808 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:56] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:56] [V] [TRT] Tactic: 0 Time: 0.004384 [05/21/2021-05:49:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004384 [05/21/2021-05:49:56] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.00486 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00486 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.011436 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.008348 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004824 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004824 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007212 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.00496 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006292 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004544 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004544 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006304 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.029444 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.0041 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0041 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007296 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005392 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005392 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007224 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.008632 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004084 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004272 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004272 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.008064 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005152 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005152 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007632 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.00506 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.00506 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.010944 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004112 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004112 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007324 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.003892 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003892 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007552 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005088 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005088 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.00784 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006632 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004924 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004924 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.0067 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.008576 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.003964 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.003964 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004052 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004052 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.0043 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0043 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007032 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005048 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005048 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.008704 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005136 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005136 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.007316 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:49:57] [V] [TRT] Tactic: 1002 Time: 0.00706 [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:49:57] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudaDepthwiseConvolution) [05/21/2021-05:49:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (FusedConvActConvolution) [05/21/2021-05:49:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:57] [V] [TRT] Tactic: 0 Time: 0.07618 [05/21/2021-05:49:57] [V] [TRT] Tactic: 1 Time: 0.06272 [05/21/2021-05:49:57] [V] [TRT] Tactic: 2 Time: 0.172844 [05/21/2021-05:49:57] [V] [TRT] Tactic: 56 Time: 0.075964 [05/21/2021-05:49:57] [V] [TRT] Tactic: 57 Time: 0.062784 [05/21/2021-05:49:57] [V] [TRT] Tactic: 58 Time: 0.1691 [05/21/2021-05:49:57] [V] [TRT] Tactic: 112 Time: 0.07344 [05/21/2021-05:49:57] [V] [TRT] Tactic: 113 Time: 0.059864 [05/21/2021-05:49:57] [V] [TRT] Tactic: 114 Time: 0.168824 [05/21/2021-05:49:57] [V] [TRT] Fastest Tactic: 113 Time: 0.059864 [05/21/2021-05:49:57] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:57] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:49:57] [V] [TRT] Tactic: 4549827808004681195 Time: 0.096368 [05/21/2021-05:49:57] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:49:58] [V] [TRT] Tactic: 5779835512569528575 Time: 0.119172 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:49:58] [V] [TRT] Tactic: 9151672657204310840 Time: 0.109952 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:49:58] [V] [TRT] Tactic: -7491730084094677098 Time: 0.157324 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:49:58] [V] [TRT] Tactic: -6313876406580483184 Time: 0.162868 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:49:58] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115988 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:49:58] [V] [TRT] Tactic: -4337126844824617177 Time: 0.089384 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:49:58] [V] [TRT] Tactic: -1123676555321336786 Time: 0.11648 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:49:58] [V] [TRT] Tactic: -701551393537224327 Time: 0.101128 [05/21/2021-05:49:58] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.089384 [05/21/2021-05:49:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 113 [05/21/2021-05:49:58] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:58] [V] [TRT] Tactic: 1663866669559596164 Time: 0.117632 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:58] [V] [TRT] Tactic: 2860655430572478466 Time: 0.07168 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4474630279712975759 Time: 0.041984 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4479823862704990365 Time: 0.042204 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4696204239951173149 Time: 0.071704 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:58] [V] [TRT] Tactic: 5778138195697110003 Time: 0.119568 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:58] [V] [TRT] Tactic: 8918020581761223752 Time: 0.11512 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:58] [V] [TRT] Tactic: -5905193483742532701 Time: 0.063468 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:58] [V] [TRT] Tactic: -4035591156787122265 Time: 0.041496 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:58] [V] [TRT] Tactic: -2809379259463049391 Time: 0.117752 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:58] [V] [TRT] Tactic: -1985235291706575900 Time: 0.114772 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:58] [V] [TRT] Tactic: -504296718212024303 Time: 0.116264 [05/21/2021-05:49:58] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.041496 [05/21/2021-05:49:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:58] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:49:58] [V] [TRT] Tactic: 1373022415249282411 Time: 0.078044 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:49:58] [V] [TRT] Tactic: 1663866669559596164 Time: 0.117632 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:49:58] [V] [TRT] Tactic: 2860655430572478466 Time: 0.072564 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4474630279712975759 Time: 0.04288 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4479823862704990365 Time: 0.042248 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:49:58] [V] [TRT] Tactic: 4696204239951173149 Time: 0.070784 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:49:58] [V] [TRT] Tactic: 5778138195697110003 Time: 0.119676 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:49:58] [V] [TRT] Tactic: 7342025736444949634 Time: 0.080384 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:49:58] [V] [TRT] Tactic: 8918020581761223752 Time: 0.115072 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:49:58] [V] [TRT] Tactic: -5905193483742532701 Time: 0.06352 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:49:58] [V] [TRT] Tactic: -5457304872213719461 Time: 0.080896 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:49:58] [V] [TRT] Tactic: -4035591156787122265 Time: 0.041284 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:49:58] [V] [TRT] Tactic: -2809379259463049391 Time: 0.117072 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:49:58] [V] [TRT] Tactic: -1985235291706575900 Time: 0.114052 [05/21/2021-05:49:58] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:49:58] [V] [TRT] Tactic: -504296718212024303 Time: 0.117888 [05/21/2021-05:49:58] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.041284 [05/21/2021-05:49:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:49:58] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1), Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:58] [V] [TRT] Tactic: 0 Time: 0.065108 [05/21/2021-05:49:58] [V] [TRT] Tactic: 1 Time: 0.058192 [05/21/2021-05:49:58] [V] [TRT] Tactic: 2 Time: 0.154884 [05/21/2021-05:49:58] [V] [TRT] Tactic: 56 Time: 0.102656 [05/21/2021-05:49:58] [V] [TRT] Tactic: 58 Time: 0.154556 [05/21/2021-05:49:58] [V] [TRT] Fastest Tactic: 1 Time: 0.058192 [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:49:58] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (FusedConvActConvolution) [05/21/2021-05:49:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:58] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:49:59] [V] [TRT] Tactic: 2195670545862694453 Time: 0.06606 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:49:59] [V] [TRT] Tactic: 3891805945559659536 Time: 0.07744 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:49:59] [V] [TRT] Tactic: 4418200634486186714 Time: 0.048508 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:49:59] [V] [TRT] Tactic: 5548126322150286555 Time: 0.054528 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:49:59] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048388 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:49:59] [V] [TRT] Tactic: 7392644644614664811 Time: 0.047616 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:49:59] [V] [TRT] Tactic: -4884039206922900293 Time: 0.074912 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:49:59] [V] [TRT] Tactic: -4374269919094467161 Time: 0.050068 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:49:59] [V] [TRT] Tactic: -1546027692247304867 Time: 0.07808 [05/21/2021-05:49:59] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.047616 [05/21/2021-05:49:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811 [05/21/2021-05:49:59] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:49:59] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:59] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:59] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:49:59] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudaDepthwiseConvolution) [05/21/2021-05:49:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:49:59] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:49:59] [V] [TRT] Tactic: 0 Time: 1.15873 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1 Time: 0.082064 [05/21/2021-05:49:59] [V] [TRT] Tactic: 2 Time: 0.147652 [05/21/2021-05:49:59] [V] [TRT] Tactic: 56 Time: 1.15816 [05/21/2021-05:49:59] [V] [TRT] Tactic: 58 Time: 0.147892 [05/21/2021-05:49:59] [V] [TRT] Fastest Tactic: 1 Time: 0.082064 [05/21/2021-05:49:59] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:49:59] [V] [TRT] Tactic: 254850674756030979 Time: 0.043684 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1011057357468998345 Time: 0.027024 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0266 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1362727228442059924 Time: 0.031008 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1576319725282257846 Time: 0.017584 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01698 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1838082074606840426 Time: 0.017252 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:49:59] [V] [TRT] Tactic: 1899296423087490472 Time: 0.013744 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:49:59] [V] [TRT] Tactic: 2238656696610018305 Time: 0.017284 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:49:59] [V] [TRT] Tactic: 2428167804343994714 Time: 0.0145 [05/21/2021-05:49:59] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:49:59] [V] [TRT] Tactic: 2541579301352125276 Time: 0.024012 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:50:00] [V] [TRT] Tactic: 2559328254295148085 Time: 0.04096 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:50:00] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011444 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:50:00] [V] [TRT] Tactic: 2968605903460894194 Time: 0.017664 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:00] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0128 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:50:00] [V] [TRT] Tactic: 3359475309458902373 Time: 0.016444 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:50:00] [V] [TRT] Tactic: 3362537467505018070 Time: 0.025812 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:50:00] [V] [TRT] Tactic: 3513075359009385578 Time: 0.044544 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:50:00] [V] [TRT] Tactic: 3704534001553878387 Time: 0.027024 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:50:00] [V] [TRT] Tactic: 4278315135102886928 Time: 0.016792 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:50:00] [V] [TRT] Tactic: 4480294673430783793 Time: 0.014336 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:50:00] [V] [TRT] Tactic: 4571819373777460444 Time: 0.041984 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:50:00] [V] [TRT] Tactic: 4802447371470387646 Time: 0.024588 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:50:00] [V] [TRT] Tactic: 5059676457552313631 Time: 0.041932 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:50:00] [V] [TRT] Tactic: 5205510332404400949 Time: 0.027908 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:50:00] [V] [TRT] Tactic: 5346855796032465921 Time: 0.025708 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:50:00] [V] [TRT] Tactic: 5368829646735632944 Time: 0.012412 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:50:00] [V] [TRT] Tactic: 5398999388616959893 Time: 0.027272 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01624 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6154447660803990543 Time: 0.01694 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6325769668000961702 Time: 0.026008 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6350273239113254096 Time: 0.013248 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6377497238381488891 Time: 0.023808 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6468794451065529747 Time: 0.015668 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010988 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:50:00] [V] [TRT] Tactic: 6979044990896381511 Time: 0.041092 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:50:00] [V] [TRT] Tactic: 7216571380637776659 Time: 0.033024 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:50:00] [V] [TRT] Tactic: 7609923741161019135 Time: 0.017032 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:50:00] [V] [TRT] Tactic: 8072087735545283117 Time: 0.043044 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:50:00] [V] [TRT] Tactic: 8101703987960976805 Time: 0.014064 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:50:00] [V] [TRT] Tactic: 8170606396342855895 Time: 0.017448 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:50:00] [V] [TRT] Tactic: 8764780417487154889 Time: 0.027008 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:50:00] [V] [TRT] Tactic: 8839784824303350101 Time: 0.030768 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:50:00] [V] [TRT] Tactic: -9009272790678027912 Time: 0.031816 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:50:00] [V] [TRT] Tactic: -8985224497679592364 Time: 0.014712 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:50:00] [V] [TRT] Tactic: -8759929675070720385 Time: 0.023552 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:50:00] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01124 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:50:00] [V] [TRT] Tactic: -8280443484414412687 Time: 0.04106 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:50:00] [V] [TRT] Tactic: -8205952393017864204 Time: 0.040576 [05/21/2021-05:50:00] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:50:01] [V] [TRT] Tactic: -8131857373260504832 Time: 0.016768 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:50:01] [V] [TRT] Tactic: -7410012245391920273 Time: 0.013952 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:50:01] [V] [TRT] Tactic: -7099920365135295801 Time: 0.015872 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:50:01] [V] [TRT] Tactic: -7089118800560870395 Time: 0.01328 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:50:01] [V] [TRT] Tactic: -6799856376604253964 Time: 0.043004 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:50:01] [V] [TRT] Tactic: -6525498856028268801 Time: 0.025256 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:50:01] [V] [TRT] Tactic: -6356316196810535311 Time: 0.014468 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:50:01] [V] [TRT] Tactic: -6324345858751792783 Time: 0.0167 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:50:01] [V] [TRT] Tactic: -6063766379489217211 Time: 0.017224 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5777580938094193096 Time: 0.014336 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5657273398217409378 Time: 0.04174 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5530886555766748586 Time: 0.023552 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5409588854490562130 Time: 0.01438 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5161596964442251102 Time: 0.01738 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:50:01] [V] [TRT] Tactic: -5127240325355316006 Time: 0.016372 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01254 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4825567853927730435 Time: 0.01638 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4796511246675321840 Time: 0.017736 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4548822885169694805 Time: 0.013708 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4379519430184503304 Time: 0.014836 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4293222705763522367 Time: 0.01024 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4152066959007262150 Time: 0.043992 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:50:01] [V] [TRT] Tactic: -4021926646879732549 Time: 0.016624 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3987638434926559037 Time: 0.017676 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3905653247016903130 Time: 0.027656 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3903974568488493144 Time: 0.017216 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3903342530518878192 Time: 0.028264 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3864869056275745423 Time: 0.028672 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010612 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3338665856053412950 Time: 0.02348 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:50:01] [V] [TRT] Tactic: -3058330359340425555 Time: 0.015368 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:50:01] [V] [TRT] Tactic: -2878731503146438856 Time: 0.02304 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:50:01] [V] [TRT] Tactic: -2662892962457732243 Time: 0.016384 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:50:01] [V] [TRT] Tactic: -2602982885923184927 Time: 0.025684 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:50:01] [V] [TRT] Tactic: -2530740716768816092 Time: 0.024272 [05/21/2021-05:50:01] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:50:01] [V] [TRT] Tactic: -2353603993968373338 Time: 0.02984 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:50:02] [V] [TRT] Tactic: -2332828394978346992 Time: 0.026396 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:50:02] [V] [TRT] Tactic: -2161909437867201546 Time: 0.013332 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:50:02] [V] [TRT] Tactic: -2032577876140256150 Time: 0.017404 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:50:02] [V] [TRT] Tactic: -2003055242756584050 Time: 0.014496 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1985778916402815946 Time: 0.025648 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1640527254204634147 Time: 0.015488 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1562548049711204899 Time: 0.02556 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1242202084391243207 Time: 0.016548 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1099247066487349374 Time: 0.013228 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:50:02] [V] [TRT] Tactic: -1038291877007553549 Time: 0.016512 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:50:02] [V] [TRT] Tactic: -910286698936744682 Time: 0.012928 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:50:02] [V] [TRT] Tactic: -606726295133751039 Time: 0.01618 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:50:02] [V] [TRT] Tactic: -406984317033388136 Time: 0.026704 [05/21/2021-05:50:02] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:50:02] [V] [TRT] Tactic: -331499326992534460 Time: 0.014596 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: -4293222705763522367 Time: 0.01024 [05/21/2021-05:50:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4293222705763522367 [05/21/2021-05:50:02] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution) [05/21/2021-05:50:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution) [05/21/2021-05:50:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.009216 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.010972 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005876 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005876 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.029728 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.00476 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00476 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007412 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004124 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004124 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.00682 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004048 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004048 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.006624 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.00536 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00536 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.011228 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004972 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004972 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007744 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004352 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004352 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.00492 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00492 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007312 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004624 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004624 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004208 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004208 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.006136 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004244 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004244 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.01216 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.008324 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.00748 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005228 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005228 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007616 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005052 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005052 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.0066 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.005044 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.005044 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.02966 [05/21/2021-05:50:02] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:50:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:50:02] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:02] [V] [TRT] Tactic: 1002 Time: 0.007716 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007644 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005896 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005896 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.009684 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004224 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004224 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007856 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004128 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005156 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005156 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.008192 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007776 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.00512 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.011144 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.0043 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0043 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007544 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.003968 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007424 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005096 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007432 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004248 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004248 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004208 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004208 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.00768 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.00658 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(6272,1:16,896,128) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007028 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007636 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005176 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005176 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,1,14336,2048) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.006664 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004736 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004736 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(25088,1:4,3584,512) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.006768 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005184 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005184 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(100352,49,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.008744 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005128 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005128 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(50176,49:2,7,1) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007776 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.005248 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.005248 [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(12544,1:8,1792,256) (Reformat) [05/21/2021-05:50:03] [V] [TRT] Tactic: 1002 Time: 0.007028 [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.004084 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.004084 [05/21/2021-05:50:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Tactic: 0 Time: 0.00576 [05/21/2021-05:50:03] [V] [TRT] Fastest Tactic: 0 Time: 0.00576 [05/21/2021-05:50:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale) [05/21/2021-05:50:03] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:03] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:50:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:03] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:50:03] [V] [TRT] Tactic: 589823 Time: 0.697 [05/21/2021-05:50:03] [V] [TRT] Tactic: 655359 Time: 0.40128 [05/21/2021-05:50:03] [V] [TRT] Tactic: 786431 Time: 0.127584 [05/21/2021-05:50:03] [V] [TRT] Tactic: 851967 Time: 0.106724 [05/21/2021-05:50:03] [V] [TRT] Tactic: 1179647 Time: 0.064804 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1310719 Time: 0.251008 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1376255 Time: 0.422792 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1441791 Time: 0.055168 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1507327 Time: 0.139136 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1638399 Time: 0.057344 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1835007 Time: 0.098432 [05/21/2021-05:50:04] [V] [TRT] Tactic: 1900543 Time: 0.418176 [05/21/2021-05:50:04] [V] [TRT] Tactic: 2097151 Time: 0.040988 [05/21/2021-05:50:04] [V] [TRT] Tactic: 2162687 Time: 0.410496 [05/21/2021-05:50:04] [V] [TRT] Tactic: 2293759 Time: 0.401408 [05/21/2021-05:50:04] [V] [TRT] Tactic: 2359295 Time: 0.221244 [05/21/2021-05:50:04] [V] [TRT] Tactic: 2686975 Time: 0.410664 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3080191 Time: 0.19842 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3342335 Time: 0.213936 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3407871 Time: 0.195584 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3538943 Time: 0.10896 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3670015 Time: 0.796672 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3932159 Time: 0.362276 [05/21/2021-05:50:04] [V] [TRT] Tactic: 3997695 Time: 0.06954 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4063231 Time: 0.108192 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4194303 Time: 0.096256 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4259839 Time: 0.033956 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4325375 Time: 0.068992 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4521983 Time: 0.3133 [05/21/2021-05:50:04] [V] [TRT] Tactic: 4587519 Time: 0.072272 [05/21/2021-05:50:05] [V] [TRT] Tactic: 4653055 Time: 0.065644 [05/21/2021-05:50:05] [V] [TRT] Tactic: 4915199 Time: 0.07168 [05/21/2021-05:50:05] [V] [TRT] Tactic: 4980735 Time: 0.209224 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5177343 Time: 0.065064 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5242879 Time: 0.193452 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5373951 Time: 0.06522 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5439487 Time: 0.12474 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5570559 Time: 0.13632 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5636095 Time: 0.0754 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5701631 Time: 0.243244 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5767167 Time: 0.207172 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5832703 Time: 0.204416 [05/21/2021-05:50:05] [V] [TRT] Tactic: 5898239 Time: 0.067712 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6029311 Time: 0.388096 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6225919 Time: 0.10702 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6291455 Time: 0.06492 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6422527 Time: 0.193548 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6750207 Time: 0.06336 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6815743 Time: 0.20432 [05/21/2021-05:50:05] [V] [TRT] Tactic: 6946815 Time: 0.079156 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7012351 Time: 0.030208 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7077887 Time: 0.070156 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7143423 Time: 0.125672 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7208959 Time: 0.204604 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7340031 Time: 0.068932 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7405567 Time: 0.100056 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7536639 Time: 0.364592 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7602175 Time: 0.119712 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7733247 Time: 0.118324 [05/21/2021-05:50:05] [V] [TRT] Tactic: 7798783 Time: 0.1275 [05/21/2021-05:50:05] [V] [TRT] Tactic: 8191999 Time: 0.107592 [05/21/2021-05:50:05] [V] [TRT] Tactic: 8257535 Time: 0.0512 [05/21/2021-05:50:05] [V] [TRT] Tactic: 8323071 Time: 0.081924 [05/21/2021-05:50:05] [V] [TRT] Tactic: 8650751 Time: 0.079872 [05/21/2021-05:50:05] [V] [TRT] Tactic: 8716287 Time: 0.068944 [05/21/2021-05:50:06] [V] [TRT] Tactic: 9109503 Time: 0.041856 [05/21/2021-05:50:06] [V] [TRT] Tactic: 9568255 Time: 0.072448 [05/21/2021-05:50:06] [V] [TRT] Tactic: 9895935 Time: 0.13674 [05/21/2021-05:50:06] [V] [TRT] Tactic: 10223615 Time: 0.410368 [05/21/2021-05:50:06] [V] [TRT] Tactic: 10354687 Time: 0.073136 [05/21/2021-05:50:06] [V] [TRT] Tactic: 10551295 Time: 0.21626 [05/21/2021-05:50:06] [V] [TRT] Tactic: 10747903 Time: 0.114568 [05/21/2021-05:50:06] [V] [TRT] Tactic: 10944511 Time: 0.209316 [05/21/2021-05:50:06] [V] [TRT] Fastest Tactic: 7012351 Time: 0.030208 [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:06] [V] [TRT] Tactic: 0 Time: 0.0806 [05/21/2021-05:50:06] [V] [TRT] Tactic: 1 Time: 0.074016 [05/21/2021-05:50:06] [V] [TRT] Tactic: 2 Time: 0.12736 [05/21/2021-05:50:06] [V] [TRT] Tactic: 4 Time: 3.56644 [05/21/2021-05:50:06] [V] [TRT] Tactic: 5 Time: 0.721356 [05/21/2021-05:50:06] [V] [TRT] Tactic: 56 Time: 0.12544 [05/21/2021-05:50:06] [V] [TRT] Tactic: 57 Time: 0.104704 [05/21/2021-05:50:06] [V] [TRT] Tactic: 58 Time: 0.211456 [05/21/2021-05:50:06] [V] [TRT] Tactic: 60 Time: 3.83488 [05/21/2021-05:50:06] [V] [TRT] Tactic: 61 Time: 0.740472 [05/21/2021-05:50:06] [V] [TRT] Tactic: 112 Time: 0.124032 [05/21/2021-05:50:06] [V] [TRT] Tactic: 113 Time: 0.103276 [05/21/2021-05:50:06] [V] [TRT] Tactic: 114 Time: 0.210048 [05/21/2021-05:50:06] [V] [TRT] Tactic: 116 Time: 3.85028 [05/21/2021-05:50:06] [V] [TRT] Tactic: 117 Time: 0.74566 [05/21/2021-05:50:06] [V] [TRT] Fastest Tactic: 1 Time: 0.074016 [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:50:06] [V] [TRT] Tactic: 4549827808004681195 Time: 0.177568 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:50:06] [V] [TRT] Tactic: 5779835512569528575 Time: 0.222492 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:50:06] [V] [TRT] Tactic: 9151672657204310840 Time: 0.172032 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:50:06] [V] [TRT] Tactic: -7491730084094677098 Time: 0.217064 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:50:06] [V] [TRT] Tactic: -6622064180404051845 Time: 0.162816 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:50:06] [V] [TRT] Tactic: -6313876406580483184 Time: 0.28904 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:50:06] [V] [TRT] Tactic: -6273689210331812572 Time: 0.219316 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:50:06] [V] [TRT] Tactic: -4337126844824617177 Time: 0.164736 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:50:06] [V] [TRT] Tactic: -1123676555321336786 Time: 0.219692 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:50:06] [V] [TRT] Tactic: -701551393537224327 Time: 0.185088 [05/21/2021-05:50:06] [V] [TRT] Fastest Tactic: -6622064180404051845 Time: 0.162816 [05/21/2021-05:50:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351 [05/21/2021-05:50:06] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(25088,1,3584,512) *************** [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:06] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:06] [V] [TRT] Tactic: 1663866669559596164 Time: 0.22336 [05/21/2021-05:50:06] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:06] [V] [TRT] Tactic: 2860655430572478466 Time: 0.131868 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4474630279712975759 Time: 0.07296 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4479823862704990365 Time: 0.07222 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4696204239951173149 Time: 0.128376 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:07] [V] [TRT] Tactic: 5778138195697110003 Time: 0.223272 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:07] [V] [TRT] Tactic: 8918020581761223752 Time: 0.211396 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:07] [V] [TRT] Tactic: -5905193483742532701 Time: 0.114944 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:07] [V] [TRT] Tactic: -4035591156787122265 Time: 0.070936 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:07] [V] [TRT] Tactic: -2809379259463049391 Time: 0.222552 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:07] [V] [TRT] Tactic: -1985235291706575900 Time: 0.216512 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:07] [V] [TRT] Tactic: -504296718212024303 Time: 0.21956 [05/21/2021-05:50:07] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.070936 [05/21/2021-05:50:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:07] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(6272,1:4,896,128) *************** [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:07] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:50:07] [V] [TRT] Tactic: 1373022415249282411 Time: 0.1522 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:07] [V] [TRT] Tactic: 1663866669559596164 Time: 0.2232 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:07] [V] [TRT] Tactic: 2860655430572478466 Time: 0.132736 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4474630279712975759 Time: 0.072832 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4479823862704990365 Time: 0.070676 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4696204239951173149 Time: 0.128128 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:07] [V] [TRT] Tactic: 5778138195697110003 Time: 0.222976 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:07] [V] [TRT] Tactic: 8918020581761223752 Time: 0.217216 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:50:07] [V] [TRT] Tactic: -7067026478815706014 Time: 0.15232 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:07] [V] [TRT] Tactic: -5905193483742532701 Time: 0.115348 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:07] [V] [TRT] Tactic: -4035591156787122265 Time: 0.070368 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:07] [V] [TRT] Tactic: -2809379259463049391 Time: 0.222388 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:07] [V] [TRT] Tactic: -1985235291706575900 Time: 0.216576 [05/21/2021-05:50:07] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:07] [V] [TRT] Tactic: -504296718212024303 Time: 0.219136 [05/21/2021-05:50:07] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.070368 [05/21/2021-05:50:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:07] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:07] [V] [TRT] Tactic: 0 Time: 0.116872 [05/21/2021-05:50:07] [V] [TRT] Tactic: 1 Time: 0.1091 [05/21/2021-05:50:07] [V] [TRT] Tactic: 2 Time: 0.14528 [05/21/2021-05:50:07] [V] [TRT] Tactic: 4 Time: 3.82257 [05/21/2021-05:50:07] [V] [TRT] Tactic: 5 Time: 0.72266 [05/21/2021-05:50:07] [V] [TRT] Tactic: 56 Time: 0.117264 [05/21/2021-05:50:07] [V] [TRT] Tactic: 58 Time: 0.143872 [05/21/2021-05:50:07] [V] [TRT] Tactic: 60 Time: 3.77141 [05/21/2021-05:50:07] [V] [TRT] Tactic: 61 Time: 0.723708 [05/21/2021-05:50:07] [V] [TRT] Fastest Tactic: 1 Time: 0.1091 [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:50:07] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:07] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(12544,49:2,7,1) *************** [05/21/2021-05:50:07] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (FusedConvActConvolution) [05/21/2021-05:50:07] [V] [TRT] Tactic: 589823 Time: 0.214016 [05/21/2021-05:50:07] [V] [TRT] Tactic: 655359 Time: 0.153872 [05/21/2021-05:50:07] [V] [TRT] Tactic: 786431 Time: 0.052876 [05/21/2021-05:50:08] [V] [TRT] Tactic: 851967 Time: 0.04262 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1179647 Time: 0.027904 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1310719 Time: 0.106656 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1376255 Time: 0.159048 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1441791 Time: 0.032392 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1507327 Time: 0.084096 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1638399 Time: 0.032 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1835007 Time: 0.04984 [05/21/2021-05:50:08] [V] [TRT] Tactic: 1900543 Time: 0.164052 [05/21/2021-05:50:08] [V] [TRT] Tactic: 2097151 Time: 0.020488 [05/21/2021-05:50:08] [V] [TRT] Tactic: 2162687 Time: 0.162816 [05/21/2021-05:50:08] [V] [TRT] Tactic: 2293759 Time: 0.13952 [05/21/2021-05:50:08] [V] [TRT] Tactic: 2359295 Time: 0.086016 [05/21/2021-05:50:08] [V] [TRT] Tactic: 2686975 Time: 0.144572 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3080191 Time: 0.074784 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3342335 Time: 0.085072 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3407871 Time: 0.073472 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3538943 Time: 0.039808 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3670015 Time: 0.301824 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3932159 Time: 0.121728 [05/21/2021-05:50:08] [V] [TRT] Tactic: 3997695 Time: 0.031424 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4063231 Time: 0.042384 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4194303 Time: 0.050696 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4259839 Time: 0.020864 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4325375 Time: 0.037888 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4521983 Time: 0.141312 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4587519 Time: 0.028196 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4653055 Time: 0.03218 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4915199 Time: 0.030464 [05/21/2021-05:50:08] [V] [TRT] Tactic: 4980735 Time: 0.071168 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5177343 Time: 0.027992 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5242879 Time: 0.068228 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5373951 Time: 0.028032 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5439487 Time: 0.046464 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5570559 Time: 0.082376 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5636095 Time: 0.0426 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5701631 Time: 0.136212 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5767167 Time: 0.068776 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5832703 Time: 0.076684 [05/21/2021-05:50:08] [V] [TRT] Tactic: 5898239 Time: 0.03392 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6029311 Time: 0.129024 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6225919 Time: 0.036736 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6291455 Time: 0.027668 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6422527 Time: 0.066432 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6750207 Time: 0.029696 [05/21/2021-05:50:08] [V] [TRT] Tactic: 6815743 Time: 0.075076 [05/21/2021-05:50:09] [V] [TRT] Tactic: 6946815 Time: 0.050252 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7012351 Time: 0.020864 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7077887 Time: 0.040188 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7143423 Time: 0.06858 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7208959 Time: 0.077324 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7340031 Time: 0.03304 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7405567 Time: 0.038916 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7536639 Time: 0.1141 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7602175 Time: 0.048512 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7733247 Time: 0.047168 [05/21/2021-05:50:09] [V] [TRT] Tactic: 7798783 Time: 0.052224 [05/21/2021-05:50:09] [V] [TRT] Tactic: 8191999 Time: 0.036964 [05/21/2021-05:50:09] [V] [TRT] Tactic: 8257535 Time: 0.030728 [05/21/2021-05:50:09] [V] [TRT] Tactic: 8323071 Time: 0.045696 [05/21/2021-05:50:09] [V] [TRT] Tactic: 8650751 Time: 0.048292 [05/21/2021-05:50:09] [V] [TRT] Tactic: 8716287 Time: 0.040628 [05/21/2021-05:50:09] [V] [TRT] Tactic: 9109503 Time: 0.020928 [05/21/2021-05:50:09] [V] [TRT] Tactic: 9568255 Time: 0.029964 [05/21/2021-05:50:09] [V] [TRT] Tactic: 9895935 Time: 0.050616 [05/21/2021-05:50:09] [V] [TRT] Tactic: 10223615 Time: 0.145024 [05/21/2021-05:50:09] [V] [TRT] Tactic: 10354687 Time: 0.026176 [05/21/2021-05:50:09] [V] [TRT] Tactic: 10551295 Time: 0.077852 [05/21/2021-05:50:09] [V] [TRT] Tactic: 10747903 Time: 0.045824 [05/21/2021-05:50:09] [V] [TRT] Tactic: 10944511 Time: 0.071136 [05/21/2021-05:50:09] [V] [TRT] Fastest Tactic: 2097151 Time: 0.020488 [05/21/2021-05:50:09] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:09] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:09] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:09] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:50:10] [V] [TRT] Tactic: 2195670545862694453 Time: 0.100472 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:50:10] [V] [TRT] Tactic: 3891805945559659536 Time: 0.144768 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:50:10] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0854 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:50:10] [V] [TRT] Tactic: 5548126322150286555 Time: 0.095392 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:50:10] [V] [TRT] Tactic: 6057304366605292508 Time: 0.090208 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:50:10] [V] [TRT] Tactic: 7392644644614664811 Time: 0.087072 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:50:10] [V] [TRT] Tactic: -4884039206922900293 Time: 0.142776 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:50:10] [V] [TRT] Tactic: -4374269919094467161 Time: 0.089856 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:50:10] [V] [TRT] Tactic: -1546027692247304867 Time: 0.145408 [05/21/2021-05:50:10] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.0854 [05/21/2021-05:50:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [05/21/2021-05:50:10] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:10] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(3136,1:8,448,64) *************** [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudaDepthwiseConvolution) [05/21/2021-05:50:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:10] [V] [TRT] Tactic: 0 Time: 1.15994 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1 Time: 0.172324 [05/21/2021-05:50:10] [V] [TRT] Tactic: 2 Time: 0.128292 [05/21/2021-05:50:10] [V] [TRT] Tactic: 56 Time: 1.15994 [05/21/2021-05:50:10] [V] [TRT] Tactic: 58 Time: 0.128832 [05/21/2021-05:50:10] [V] [TRT] Fastest Tactic: 2 Time: 0.128292 [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:10] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:50:10] [V] [TRT] Tactic: 254850674756030979 Time: 0.076684 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1156328698016730421 Time: 0.046208 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0476 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1576319725282257846 Time: 0.024124 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1832046141070096030 Time: 0.023668 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1838082074606840426 Time: 0.023552 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:50:10] [V] [TRT] Tactic: 1899296423087490472 Time: 0.014696 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:50:10] [V] [TRT] Tactic: 2238656696610018305 Time: 0.024448 [05/21/2021-05:50:10] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:50:11] [V] [TRT] Tactic: 2541579301352125276 Time: 0.042112 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:50:11] [V] [TRT] Tactic: 2559328254295148085 Time: 0.075904 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:50:11] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01562 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:50:11] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0242 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3071479995783211391 Time: 0.01144 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3359475309458902373 Time: 0.023708 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3362537467505018070 Time: 0.041284 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3513075359009385578 Time: 0.076928 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3704534001553878387 Time: 0.043008 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:50:11] [V] [TRT] Tactic: 3899310434460415852 Time: 0.013352 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4278315135102886928 Time: 0.023764 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4370476717970497892 Time: 0.022956 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4480294673430783793 Time: 0.02372 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4491683531415781597 Time: 0.075096 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4528997467275241200 Time: 0.040892 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4571819373777460444 Time: 0.07722 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4595173549602041350 Time: 0.075716 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4802447371470387646 Time: 0.04352 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:50:11] [V] [TRT] Tactic: 4993757826442493905 Time: 0.022392 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:50:11] [V] [TRT] Tactic: 5059676457552313631 Time: 0.075172 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:50:11] [V] [TRT] Tactic: 5205510332404400949 Time: 0.039936 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:50:11] [V] [TRT] Tactic: 5346855796032465921 Time: 0.039936 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:50:11] [V] [TRT] Tactic: 5398999388616959893 Time: 0.043988 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:50:11] [V] [TRT] Tactic: 6034364043891107501 Time: 0.023552 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:50:11] [V] [TRT] Tactic: 6377497238381488891 Time: 0.040992 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:50:11] [V] [TRT] Tactic: 6468794451065529747 Time: 0.024344 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:11] [V] [TRT] Tactic: 6697277555581639516 Time: 0.02326 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:50:11] [V] [TRT] Tactic: 6859477213531075460 Time: 0.015392 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:50:11] [V] [TRT] Tactic: 7216571380637776659 Time: 0.051584 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:50:11] [V] [TRT] Tactic: 7609923741161019135 Time: 0.023868 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:50:11] [V] [TRT] Tactic: 8101703987960976805 Time: 0.015816 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:50:11] [V] [TRT] Tactic: 8170606396342855895 Time: 0.023552 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:50:11] [V] [TRT] Tactic: 8764780417487154889 Time: 0.043352 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:50:11] [V] [TRT] Tactic: 8823554289762712606 Time: 0.023844 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:50:11] [V] [TRT] Tactic: 8839784824303350101 Time: 0.046892 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:11] [V] [TRT] Tactic: -9203179519031456182 Time: 0.016648 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:50:11] [V] [TRT] Tactic: -9009272790678027912 Time: 0.046848 [05/21/2021-05:50:11] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:50:12] [V] [TRT] Tactic: -8604374562669615024 Time: 0.015912 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:50:12] [V] [TRT] Tactic: -8280443484414412687 Time: 0.075392 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:50:12] [V] [TRT] Tactic: -8205952393017864204 Time: 0.075264 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:50:12] [V] [TRT] Tactic: -8131857373260504832 Time: 0.02254 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:50:12] [V] [TRT] Tactic: -7410012245391920273 Time: 0.01536 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:50:12] [V] [TRT] Tactic: -7099920365135295801 Time: 0.02202 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:50:12] [V] [TRT] Tactic: -7089118800560870395 Time: 0.014336 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:12] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0413 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:50:12] [V] [TRT] Tactic: -6356316196810535311 Time: 0.016764 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:50:12] [V] [TRT] Tactic: -6063766379489217211 Time: 0.024136 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:50:12] [V] [TRT] Tactic: -5530886555766748586 Time: 0.041448 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:12] [V] [TRT] Tactic: -5409588854490562130 Time: 0.016812 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:50:12] [V] [TRT] Tactic: -5161596964442251102 Time: 0.023996 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:50:12] [V] [TRT] Tactic: -5127240325355316006 Time: 0.02338 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4950923835688973492 Time: 0.014584 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4796511246675321840 Time: 0.024208 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4548822885169694805 Time: 0.014616 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4379519430184503304 Time: 0.023296 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4293222705763522367 Time: 0.014324 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0768 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:50:12] [V] [TRT] Tactic: -4021926646879732549 Time: 0.023704 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3987638434926559037 Time: 0.024624 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3905653247016903130 Time: 0.044332 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3903342530518878192 Time: 0.04154 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3864869056275745423 Time: 0.042404 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3601464762214218301 Time: 0.015332 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:50:12] [V] [TRT] Tactic: -3058330359340425555 Time: 0.023936 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:50:12] [V] [TRT] Tactic: -2878731503146438856 Time: 0.041256 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:50:12] [V] [TRT] Tactic: -2602982885923184927 Time: 0.040216 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:50:12] [V] [TRT] Tactic: -2353603993968373338 Time: 0.041984 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:50:12] [V] [TRT] Tactic: -2032577876140256150 Time: 0.02354 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:50:12] [V] [TRT] Tactic: -2003055242756584050 Time: 0.023972 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1985778916402815946 Time: 0.044804 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1828674067637788567 Time: 0.011392 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1640527254204634147 Time: 0.02392 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1562548049711204899 Time: 0.041472 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1242202084391243207 Time: 0.023656 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1099247066487349374 Time: 0.015528 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:50:12] [V] [TRT] Tactic: -1038291877007553549 Time: 0.023424 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:50:12] [V] [TRT] Tactic: -406984317033388136 Time: 0.043048 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:50:12] [V] [TRT] Tactic: -331499326992534460 Time: 0.022528 [05/21/2021-05:50:12] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:50:13] [V] [TRT] Tactic: -206523504474952360 Time: 0.039912 [05/21/2021-05:50:13] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.011392 [05/21/2021-05:50:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567 [05/21/2021-05:50:13] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(1568,1:16,224,32) *************** [05/21/2021-05:50:13] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution) [05/21/2021-05:50:13] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:13] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution) [05/21/2021-05:50:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:13] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution) [05/21/2021-05:50:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:13] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:13] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:50:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:13] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:50:13] [V] [TRT] Tactic: 524287 Time: 0.268212 [05/21/2021-05:50:13] [V] [TRT] Tactic: 720895 Time: 0.19692 [05/21/2021-05:50:13] [V] [TRT] Tactic: 983039 Time: 0.101076 [05/21/2021-05:50:13] [V] [TRT] Tactic: 1048575 Time: 0.17792 [05/21/2021-05:50:13] [V] [TRT] Tactic: 1703935 Time: 0.093608 [05/21/2021-05:50:13] [V] [TRT] Tactic: 1769471 Time: 0.085324 [05/21/2021-05:50:13] [V] [TRT] Tactic: 1966079 Time: 0.417664 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2031615 Time: 0.341204 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2228223 Time: 0.161768 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2424831 Time: 0.062228 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2621439 Time: 0.066164 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2752511 Time: 0.212248 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2818047 Time: 0.184872 [05/21/2021-05:50:13] [V] [TRT] Tactic: 2883583 Time: 0.461792 [05/21/2021-05:50:13] [V] [TRT] Tactic: 3014655 Time: 0.1005 [05/21/2021-05:50:13] [V] [TRT] Tactic: 3145727 Time: 0.107648 [05/21/2021-05:50:13] [V] [TRT] Tactic: 3473407 Time: 0.242204 [05/21/2021-05:50:13] [V] [TRT] Tactic: 3604479 Time: 0.106196 [05/21/2021-05:50:13] [V] [TRT] Tactic: 3735551 Time: 0.235964 [05/21/2021-05:50:13] [V] [TRT] Tactic: 4390911 Time: 0.427792 [05/21/2021-05:50:13] [V] [TRT] Tactic: 5046271 Time: 0.158764 [05/21/2021-05:50:13] [V] [TRT] Tactic: 5963775 Time: 0.373336 [05/21/2021-05:50:13] [V] [TRT] Tactic: 6160383 Time: 0.215576 [05/21/2021-05:50:14] [V] [TRT] Tactic: 6488063 Time: 0.189708 [05/21/2021-05:50:14] [V] [TRT] Tactic: 6881279 Time: 0.31168 [05/21/2021-05:50:14] [V] [TRT] Tactic: 7274495 Time: 0.076288 [05/21/2021-05:50:14] [V] [TRT] Tactic: 7864319 Time: 0.070272 [05/21/2021-05:50:14] [V] [TRT] Tactic: 7995391 Time: 0.214252 [05/21/2021-05:50:14] [V] [TRT] Tactic: 8585215 Time: 0.295552 [05/21/2021-05:50:14] [V] [TRT] Tactic: 8847359 Time: 0.073704 [05/21/2021-05:50:14] [V] [TRT] Tactic: 8978431 Time: 0.379592 [05/21/2021-05:50:14] [V] [TRT] Tactic: 9043967 Time: 0.104232 [05/21/2021-05:50:14] [V] [TRT] Tactic: 9175039 Time: 0.105728 [05/21/2021-05:50:14] [V] [TRT] Tactic: 9502719 Time: 0.413056 [05/21/2021-05:50:14] [V] [TRT] Tactic: 9830399 Time: 0.218504 [05/21/2021-05:50:14] [V] [TRT] Tactic: 9961471 Time: 0.071364 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10027007 Time: 0.165848 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10092543 Time: 0.428108 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10289151 Time: 0.417628 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10485759 Time: 0.088628 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10682367 Time: 0.06472 [05/21/2021-05:50:14] [V] [TRT] Tactic: 10813439 Time: 0.112656 [05/21/2021-05:50:14] [V] [TRT] Fastest Tactic: 2424831 Time: 0.062228 [05/21/2021-05:50:14] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:14] [V] [TRT] Tactic: 0 Time: 0.27712 [05/21/2021-05:50:14] [V] [TRT] Tactic: 1 Time: 0.091748 [05/21/2021-05:50:14] [V] [TRT] Tactic: 2 Time: 0.278272 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4 Time: 0.993988 [05/21/2021-05:50:15] [V] [TRT] Tactic: 5 Time: 2.91073 [05/21/2021-05:50:15] [V] [TRT] Tactic: 6 Time: 0.124104 [05/21/2021-05:50:15] [V] [TRT] Tactic: 56 Time: 0.27872 [05/21/2021-05:50:15] [V] [TRT] Tactic: 57 Time: 0.09216 [05/21/2021-05:50:15] [V] [TRT] Tactic: 58 Time: 0.278272 [05/21/2021-05:50:15] [V] [TRT] Tactic: 60 Time: 0.962744 [05/21/2021-05:50:15] [V] [TRT] Tactic: 61 Time: 3.20419 [05/21/2021-05:50:15] [V] [TRT] Tactic: 62 Time: 0.123008 [05/21/2021-05:50:15] [V] [TRT] Tactic: 112 Time: 0.277248 [05/21/2021-05:50:15] [V] [TRT] Tactic: 113 Time: 0.276992 [05/21/2021-05:50:15] [V] [TRT] Tactic: 114 Time: 0.278144 [05/21/2021-05:50:15] [V] [TRT] Tactic: 116 Time: 0.961664 [05/21/2021-05:50:15] [V] [TRT] Tactic: 117 Time: 3.19761 [05/21/2021-05:50:15] [V] [TRT] Tactic: 118 Time: 0.12416 [05/21/2021-05:50:15] [V] [TRT] Fastest Tactic: 1 Time: 0.091748 [05/21/2021-05:50:15] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4549827808004681195 Time: 0.3843 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:50:15] [V] [TRT] Tactic: 5779835512569528575 Time: 0.490496 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720 [05/21/2021-05:50:15] [V] [TRT] Tactic: 6053873026024413720 Time: 0.516064 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815 [05/21/2021-05:50:15] [V] [TRT] Tactic: 6767548733843469815 Time: 0.42322 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:50:15] [V] [TRT] Tactic: -6313876406580483184 Time: 0.538944 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:50:15] [V] [TRT] Tactic: -1123676555321336786 Time: 0.5114 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:50:15] [V] [TRT] Tactic: -701551393537224327 Time: 0.446208 [05/21/2021-05:50:15] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.3843 [05/21/2021-05:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831 [05/21/2021-05:50:15] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(25088,1,3584,512) *************** [05/21/2021-05:50:15] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:15] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:15] [V] [TRT] Tactic: 2860655430572478466 Time: 0.285824 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4474630279712975759 Time: 0.155612 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4479823862704990365 Time: 0.152652 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4696204239951173149 Time: 0.286296 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:15] [V] [TRT] Tactic: 5778138195697110003 Time: 0.490496 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:50:15] [V] [TRT] Tactic: 7155825427510256858 Time: 0.485376 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:15] [V] [TRT] Tactic: 8918020581761223752 Time: 0.479564 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:50:15] [V] [TRT] Tactic: -4756382386362004279 Time: 0.280088 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:50:15] [V] [TRT] Tactic: -3855385237722507464 Time: 0.497536 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:15] [V] [TRT] Tactic: -2809379259463049391 Time: 0.487028 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:15] [V] [TRT] Tactic: -504296718212024303 Time: 0.476032 [05/21/2021-05:50:15] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.152652 [05/21/2021-05:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:50:15] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(6272,1:4,896,128) *************** [05/21/2021-05:50:15] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:15] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:15] [V] [TRT] Tactic: 2860655430572478466 Time: 0.28672 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:15] [V] [TRT] Tactic: 4474630279712975759 Time: 0.155676 [05/21/2021-05:50:15] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:16] [V] [TRT] Tactic: 4479823862704990365 Time: 0.152576 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:16] [V] [TRT] Tactic: 4696204239951173149 Time: 0.286408 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:16] [V] [TRT] Tactic: 5778138195697110003 Time: 0.490452 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858 [05/21/2021-05:50:16] [V] [TRT] Tactic: 7155825427510256858 Time: 0.485716 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634 [05/21/2021-05:50:16] [V] [TRT] Tactic: 7342025736444949634 Time: 0.332868 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:16] [V] [TRT] Tactic: 8918020581761223752 Time: 0.478908 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330 [05/21/2021-05:50:16] [V] [TRT] Tactic: -7377458734869418330 Time: 0.320008 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461 [05/21/2021-05:50:16] [V] [TRT] Tactic: -5457304872213719461 Time: 0.323864 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279 [05/21/2021-05:50:16] [V] [TRT] Tactic: -4756382386362004279 Time: 0.281 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464 [05/21/2021-05:50:16] [V] [TRT] Tactic: -3855385237722507464 Time: 0.501764 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:16] [V] [TRT] Tactic: -2809379259463049391 Time: 0.485988 [05/21/2021-05:50:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:16] [V] [TRT] Tactic: -504296718212024303 Time: 0.474388 [05/21/2021-05:50:16] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.152576 [05/21/2021-05:50:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [05/21/2021-05:50:16] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:16] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:16] [V] [TRT] Tactic: 0 Time: 0.30722 [05/21/2021-05:50:16] [V] [TRT] Tactic: 1 Time: 0.307052 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2 Time: 0.2652 [05/21/2021-05:50:16] [V] [TRT] Tactic: 4 Time: 0.906232 [05/21/2021-05:50:16] [V] [TRT] Tactic: 5 Time: 3.14225 [05/21/2021-05:50:16] [V] [TRT] Tactic: 6 Time: 0.144 [05/21/2021-05:50:16] [V] [TRT] Tactic: 56 Time: 0.308356 [05/21/2021-05:50:16] [V] [TRT] Tactic: 58 Time: 0.2656 [05/21/2021-05:50:16] [V] [TRT] Tactic: 60 Time: 0.906056 [05/21/2021-05:50:16] [V] [TRT] Tactic: 61 Time: 3.1453 [05/21/2021-05:50:16] [V] [TRT] Tactic: 62 Time: 0.14464 [05/21/2021-05:50:16] [V] [TRT] Fastest Tactic: 6 Time: 0.144 [05/21/2021-05:50:16] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [05/21/2021-05:50:16] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(12544,49:2,7,1) *************** [05/21/2021-05:50:16] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (FusedConvActConvolution) [05/21/2021-05:50:16] [V] [TRT] Tactic: 524287 Time: 0.124916 [05/21/2021-05:50:16] [V] [TRT] Tactic: 720895 Time: 0.10496 [05/21/2021-05:50:16] [V] [TRT] Tactic: 983039 Time: 0.052236 [05/21/2021-05:50:16] [V] [TRT] Tactic: 1048575 Time: 0.081196 [05/21/2021-05:50:16] [V] [TRT] Tactic: 1703935 Time: 0.044032 [05/21/2021-05:50:16] [V] [TRT] Tactic: 1769471 Time: 0.055552 [05/21/2021-05:50:16] [V] [TRT] Tactic: 1966079 Time: 0.251252 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2031615 Time: 0.216392 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2228223 Time: 0.097684 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2424831 Time: 0.038528 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2621439 Time: 0.040872 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2752511 Time: 0.138308 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2818047 Time: 0.117176 [05/21/2021-05:50:16] [V] [TRT] Tactic: 2883583 Time: 0.313728 [05/21/2021-05:50:16] [V] [TRT] Tactic: 3014655 Time: 0.053272 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3145727 Time: 0.060928 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3473407 Time: 0.129384 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3604479 Time: 0.053264 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3735551 Time: 0.102432 [05/21/2021-05:50:17] [V] [TRT] Tactic: 4390911 Time: 0.270464 [05/21/2021-05:50:17] [V] [TRT] Tactic: 5046271 Time: 0.0899 [05/21/2021-05:50:17] [V] [TRT] Tactic: 5963775 Time: 0.2758 [05/21/2021-05:50:17] [V] [TRT] Tactic: 6160383 Time: 0.156032 [05/21/2021-05:50:17] [V] [TRT] Tactic: 6488063 Time: 0.12442 [05/21/2021-05:50:17] [V] [TRT] Tactic: 6881279 Time: 0.199392 [05/21/2021-05:50:17] [V] [TRT] Tactic: 7274495 Time: 0.04888 [05/21/2021-05:50:17] [V] [TRT] Tactic: 7864319 Time: 0.041036 [05/21/2021-05:50:17] [V] [TRT] Tactic: 7995391 Time: 0.151564 [05/21/2021-05:50:17] [V] [TRT] Tactic: 8585215 Time: 0.142336 [05/21/2021-05:50:17] [V] [TRT] Tactic: 8847359 Time: 0.038908 [05/21/2021-05:50:17] [V] [TRT] Tactic: 8978431 Time: 0.193536 [05/21/2021-05:50:17] [V] [TRT] Tactic: 9043967 Time: 0.05618 [05/21/2021-05:50:17] [V] [TRT] Tactic: 9175039 Time: 0.066816 [05/21/2021-05:50:17] [V] [TRT] Tactic: 9502719 Time: 0.268672 [05/21/2021-05:50:17] [V] [TRT] Tactic: 9830399 Time: 0.146304 [05/21/2021-05:50:17] [V] [TRT] Tactic: 9961471 Time: 0.043688 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10027007 Time: 0.09792 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10092543 Time: 0.270156 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10289151 Time: 0.25088 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10485759 Time: 0.051904 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10682367 Time: 0.040856 [05/21/2021-05:50:17] [V] [TRT] Tactic: 10813439 Time: 0.057344 [05/21/2021-05:50:17] [V] [TRT] Fastest Tactic: 2424831 Time: 0.038528 [05/21/2021-05:50:17] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:17] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:50:17] [V] [TRT] Tactic: 2195670545862694453 Time: 0.24576 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3419182076704469245 Time: 0.236956 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:50:17] [V] [TRT] Tactic: 3891805945559659536 Time: 0.32354 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:50:17] [V] [TRT] Tactic: 5548126322150286555 Time: 0.228096 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:50:17] [V] [TRT] Tactic: 6057304366605292508 Time: 0.196416 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652 [05/21/2021-05:50:17] [V] [TRT] Tactic: -7928611605886347652 Time: 0.333952 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:50:17] [V] [TRT] Tactic: -5172391392092686714 Time: 0.280292 [05/21/2021-05:50:17] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:50:17] [V] [TRT] Tactic: -4374269919094467161 Time: 0.206472 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953 [05/21/2021-05:50:18] [V] [TRT] Tactic: -4083394051665370953 Time: 0.04766 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:50:18] [V] [TRT] Tactic: -1546027692247304867 Time: 0.319744 [05/21/2021-05:50:18] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.04766 [05/21/2021-05:50:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831 [05/21/2021-05:50:18] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:18] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:18] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:18] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:18] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(3136,1:8,448,64) *************** [05/21/2021-05:50:18] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudaDepthwiseConvolution) [05/21/2021-05:50:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:18] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:18] [V] [TRT] Tactic: 0 Time: 0.233 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1 Time: 0.233628 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2 Time: 0.223636 [05/21/2021-05:50:18] [V] [TRT] Tactic: 6 Time: 0.138752 [05/21/2021-05:50:18] [V] [TRT] Tactic: 56 Time: 0.271232 [05/21/2021-05:50:18] [V] [TRT] Tactic: 58 Time: 0.236336 [05/21/2021-05:50:18] [V] [TRT] Tactic: 62 Time: 0.138496 [05/21/2021-05:50:18] [V] [TRT] Fastest Tactic: 62 Time: 0.138496 [05/21/2021-05:50:18] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:50:18] [V] [TRT] Tactic: 254850674756030979 Time: 0.163456 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625 [05/21/2021-05:50:18] [V] [TRT] Tactic: 328038211831149625 Time: 0.160424 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917 [05/21/2021-05:50:18] [V] [TRT] Tactic: 411553864378931917 Time: 0.045232 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1011057357468998345 Time: 0.090616 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1156328698016730421 Time: 0.096896 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1723736032573714698 Time: 0.04536 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1832046141070096030 Time: 0.045056 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1838082074606840426 Time: 0.045044 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:50:18] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0256 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2428167804343994714 Time: 0.047616 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2541579301352125276 Time: 0.092324 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2657157263811141609 Time: 0.026612 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2819719497590964443 Time: 0.046768 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2968605903460894194 Time: 0.045932 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765 [05/21/2021-05:50:18] [V] [TRT] Tactic: 2986078304285316765 Time: 0.09464 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:50:18] [V] [TRT] Tactic: 3362537467505018070 Time: 0.083916 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:50:18] [V] [TRT] Tactic: 3513075359009385578 Time: 0.16616 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382 [05/21/2021-05:50:18] [V] [TRT] Tactic: 3573559043797674382 Time: 0.04736 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777 [05/21/2021-05:50:18] [V] [TRT] Tactic: 3591970081995419777 Time: 0.025964 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:50:18] [V] [TRT] Tactic: 3704534001553878387 Time: 0.088248 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:50:18] [V] [TRT] Tactic: 4278315135102886928 Time: 0.044352 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107 [05/21/2021-05:50:18] [V] [TRT] Tactic: 4503233883285355107 Time: 0.031748 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:50:18] [V] [TRT] Tactic: 4802447371470387646 Time: 0.086016 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5059676457552313631 Time: 0.162752 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5368829646735632944 Time: 0.029056 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5398999388616959893 Time: 0.08878 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5746691132547383910 Time: 0.046576 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5770170567977052602 Time: 0.100812 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549 [05/21/2021-05:50:18] [V] [TRT] Tactic: 5953552212833506549 Time: 0.083936 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:50:18] [V] [TRT] Tactic: 6034364043891107501 Time: 0.045356 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232 [05/21/2021-05:50:18] [V] [TRT] Tactic: 6074229447555668232 Time: 0.029148 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543 [05/21/2021-05:50:18] [V] [TRT] Tactic: 6154447660803990543 Time: 0.045788 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702 [05/21/2021-05:50:18] [V] [TRT] Tactic: 6325769668000961702 Time: 0.084304 [05/21/2021-05:50:18] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6350273239113254096 Time: 0.018788 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6377497238381488891 Time: 0.082944 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6446388116965632819 Time: 0.047104 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0473 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6642277870194067185 Time: 0.171036 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6859477213531075460 Time: 0.027844 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6972489290272968208 Time: 0.084644 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511 [05/21/2021-05:50:19] [V] [TRT] Tactic: 6979044990896381511 Time: 0.160384 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:50:19] [V] [TRT] Tactic: 7216571380637776659 Time: 0.11702 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:50:19] [V] [TRT] Tactic: 7609923741161019135 Time: 0.045056 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201 [05/21/2021-05:50:19] [V] [TRT] Tactic: 7705739241028240201 Time: 0.028672 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117 [05/21/2021-05:50:19] [V] [TRT] Tactic: 8072087735545283117 Time: 0.162992 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:50:19] [V] [TRT] Tactic: 8101703987960976805 Time: 0.02866 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:50:19] [V] [TRT] Tactic: 8170606396342855895 Time: 0.046732 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:50:19] [V] [TRT] Tactic: 8839784824303350101 Time: 0.107076 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773 [05/21/2021-05:50:19] [V] [TRT] Tactic: -9217371357561775773 Time: 0.029184 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:50:19] [V] [TRT] Tactic: -9009272790678027912 Time: 0.10882 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364 [05/21/2021-05:50:19] [V] [TRT] Tactic: -8985224497679592364 Time: 0.035028 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679 [05/21/2021-05:50:19] [V] [TRT] Tactic: -8949544755481315679 Time: 0.047604 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385 [05/21/2021-05:50:19] [V] [TRT] Tactic: -8759929675070720385 Time: 0.085716 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:50:19] [V] [TRT] Tactic: -8604374562669615024 Time: 0.028312 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:19] [V] [TRT] Tactic: -6902925267326201166 Time: 0.022144 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325 [05/21/2021-05:50:19] [V] [TRT] Tactic: -6840588038605932325 Time: 0.04504 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964 [05/21/2021-05:50:19] [V] [TRT] Tactic: -6799856376604253964 Time: 0.160904 [05/21/2021-05:50:19] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6625722781282978136 Time: 0.046108 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6525498856028268801 Time: 0.086072 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6356316196810535311 Time: 0.030096 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6324345858751792783 Time: 0.04502 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6262400699544994312 Time: 0.158848 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6257787336162086472 Time: 0.096504 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:50:20] [V] [TRT] Tactic: -6063766379489217211 Time: 0.046224 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5777580938094193096 Time: 0.048 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5657273398217409378 Time: 0.164768 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5530886555766748586 Time: 0.092172 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5422685219138380548 Time: 0.045152 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5161596964442251102 Time: 0.045824 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:50:20] [V] [TRT] Tactic: -5127240325355316006 Time: 0.044032 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4825567853927730435 Time: 0.044156 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4796511246675321840 Time: 0.045184 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4706569565442112734 Time: 0.029644 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4566599693570369588 Time: 0.085632 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4409144516525410768 Time: 0.084992 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4379519430184503304 Time: 0.04608 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4152066959007262150 Time: 0.164736 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:50:20] [V] [TRT] Tactic: -4021926646879732549 Time: 0.04574 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3987638434926559037 Time: 0.046328 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3905653247016903130 Time: 0.091264 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3903974568488493144 Time: 0.052308 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3895429239811098010 Time: 0.044416 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3864869056275745423 Time: 0.08576 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3601464762214218301 Time: 0.025856 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3412636942650049698 Time: 0.092084 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3338665856053412950 Time: 0.085156 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:50:20] [V] [TRT] Tactic: -3058330359340425555 Time: 0.045912 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2816084650627734155 Time: 0.109232 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2662892962457732243 Time: 0.04552 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2559894581585337900 Time: 0.16264 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2530740716768816092 Time: 0.080996 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2332828394978346992 Time: 0.084608 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2241736083352441442 Time: 0.115584 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546 [05/21/2021-05:50:20] [V] [TRT] Tactic: -2161909437867201546 Time: 0.02596 [05/21/2021-05:50:20] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:50:21] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0891 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076 [05/21/2021-05:50:21] [V] [TRT] Tactic: -1500496213132463076 Time: 0.046744 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:50:21] [V] [TRT] Tactic: -1099247066487349374 Time: 0.02674 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:50:21] [V] [TRT] Tactic: -910286698936744682 Time: 0.02624 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039 [05/21/2021-05:50:21] [V] [TRT] Tactic: -606726295133751039 Time: 0.049304 [05/21/2021-05:50:21] [V] [TRT] Fastest Tactic: 6350273239113254096 Time: 0.018788 [05/21/2021-05:50:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6350273239113254096 [05/21/2021-05:50:21] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(1568,1:16,224,32) *************** [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution) [05/21/2021-05:50:21] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution) [05/21/2021-05:50:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:21] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudaDepthwiseConvolution) [05/21/2021-05:50:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (FusedConvActConvolution) [05/21/2021-05:50:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:21] [V] [TRT] Tactic: 0 Time: 0.041936 [05/21/2021-05:50:21] [V] [TRT] Tactic: 1 Time: 0.035984 [05/21/2021-05:50:21] [V] [TRT] Tactic: 2 Time: 0.135424 [05/21/2021-05:50:21] [V] [TRT] Tactic: 4 Time: 3.87465 [05/21/2021-05:50:21] [V] [TRT] Tactic: 5 Time: 0.693212 [05/21/2021-05:50:21] [V] [TRT] Tactic: 56 Time: 0.042104 [05/21/2021-05:50:21] [V] [TRT] Tactic: 57 Time: 0.036108 [05/21/2021-05:50:21] [V] [TRT] Tactic: 58 Time: 0.13538 [05/21/2021-05:50:21] [V] [TRT] Tactic: 60 Time: 3.83809 [05/21/2021-05:50:21] [V] [TRT] Tactic: 61 Time: 0.691072 [05/21/2021-05:50:21] [V] [TRT] Tactic: 112 Time: 0.042768 [05/21/2021-05:50:21] [V] [TRT] Tactic: 113 Time: 0.036624 [05/21/2021-05:50:21] [V] [TRT] Tactic: 114 Time: 0.136116 [05/21/2021-05:50:21] [V] [TRT] Tactic: 116 Time: 3.85122 [05/21/2021-05:50:21] [V] [TRT] Tactic: 117 Time: 0.691264 [05/21/2021-05:50:21] [V] [TRT] Fastest Tactic: 1 Time: 0.035984 [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:21] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:50:21] [V] [TRT] Tactic: 4549827808004681195 Time: 0.052808 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:50:21] [V] [TRT] Tactic: 5779835512569528575 Time: 0.068144 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:50:21] [V] [TRT] Tactic: 9151672657204310840 Time: 0.072768 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:50:21] [V] [TRT] Tactic: -7491730084094677098 Time: 0.080636 [05/21/2021-05:50:21] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:50:21] [V] [TRT] Tactic: -6622064180404051845 Time: 0.066732 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:50:22] [V] [TRT] Tactic: -6313876406580483184 Time: 0.082916 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:50:22] [V] [TRT] Tactic: -6273689210331812572 Time: 0.063448 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:50:22] [V] [TRT] Tactic: -4337126844824617177 Time: 0.049472 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:50:22] [V] [TRT] Tactic: -1123676555321336786 Time: 0.063952 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:50:22] [V] [TRT] Tactic: -701551393537224327 Time: 0.051584 [05/21/2021-05:50:22] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.049472 [05/21/2021-05:50:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [05/21/2021-05:50:22] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:22] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06416 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:22] [V] [TRT] Tactic: 2860655430572478466 Time: 0.041508 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026628 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4479823862704990365 Time: 0.026568 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4696204239951173149 Time: 0.040832 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:22] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06452 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:22] [V] [TRT] Tactic: 8918020581761223752 Time: 0.062228 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:22] [V] [TRT] Tactic: -5905193483742532701 Time: 0.036932 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:22] [V] [TRT] Tactic: -4035591156787122265 Time: 0.026028 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:22] [V] [TRT] Tactic: -2809379259463049391 Time: 0.060876 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:22] [V] [TRT] Tactic: -1985235291706575900 Time: 0.058544 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:22] [V] [TRT] Tactic: -504296718212024303 Time: 0.059372 [05/21/2021-05:50:22] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.026028 [05/21/2021-05:50:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:22] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:50:22] [V] [TRT] Tactic: 1373022415249282411 Time: 0.045952 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:22] [V] [TRT] Tactic: 1663866669559596164 Time: 0.064256 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:22] [V] [TRT] Tactic: 2860655430572478466 Time: 0.041152 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026752 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4479823862704990365 Time: 0.02668 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:22] [V] [TRT] Tactic: 4696204239951173149 Time: 0.04068 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:22] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0646 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:22] [V] [TRT] Tactic: 8918020581761223752 Time: 0.058868 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:50:22] [V] [TRT] Tactic: -7067026478815706014 Time: 0.042152 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:22] [V] [TRT] Tactic: -5905193483742532701 Time: 0.036352 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:22] [V] [TRT] Tactic: -4035591156787122265 Time: 0.026284 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:22] [V] [TRT] Tactic: -2809379259463049391 Time: 0.064012 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:22] [V] [TRT] Tactic: -1985235291706575900 Time: 0.061696 [05/21/2021-05:50:22] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:22] [V] [TRT] Tactic: -504296718212024303 Time: 0.062728 [05/21/2021-05:50:22] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.026284 [05/21/2021-05:50:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:22] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1), Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:50:22] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:22] [V] [TRT] Tactic: 0 Time: 0.033084 [05/21/2021-05:50:22] [V] [TRT] Tactic: 1 Time: 0.03476 [05/21/2021-05:50:22] [V] [TRT] Tactic: 2 Time: 0.09198 [05/21/2021-05:50:23] [V] [TRT] Tactic: 4 Time: 3.49342 [05/21/2021-05:50:23] [V] [TRT] Tactic: 5 Time: 0.638612 [05/21/2021-05:50:23] [V] [TRT] Tactic: 56 Time: 0.0368 [05/21/2021-05:50:23] [V] [TRT] Tactic: 58 Time: 0.093024 [05/21/2021-05:50:23] [V] [TRT] Tactic: 60 Time: 3.84471 [05/21/2021-05:50:23] [V] [TRT] Tactic: 61 Time: 0.653696 [05/21/2021-05:50:23] [V] [TRT] Fastest Tactic: 0 Time: 0.033084 [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [05/21/2021-05:50:23] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (FusedConvActConvolution) [05/21/2021-05:50:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2195670545862694453 Time: 0.031568 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:50:23] [V] [TRT] Tactic: 3891805945559659536 Time: 0.041448 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:50:23] [V] [TRT] Tactic: 4418200634486186714 Time: 0.025928 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:50:23] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0288 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:50:23] [V] [TRT] Tactic: 6057304366605292508 Time: 0.027648 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:50:23] [V] [TRT] Tactic: 7392644644614664811 Time: 0.028288 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:50:23] [V] [TRT] Tactic: -4884039206922900293 Time: 0.042024 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:50:23] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028928 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:50:23] [V] [TRT] Tactic: -1546027692247304867 Time: 0.042752 [05/21/2021-05:50:23] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.025928 [05/21/2021-05:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:50:23] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudaDepthwiseConvolution) [05/21/2021-05:50:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:23] [V] [TRT] Tactic: 0 Time: 0.583944 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1 Time: 0.05558 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2 Time: 0.07656 [05/21/2021-05:50:23] [V] [TRT] Tactic: 56 Time: 0.58384 [05/21/2021-05:50:23] [V] [TRT] Tactic: 58 Time: 0.07664 [05/21/2021-05:50:23] [V] [TRT] Fastest Tactic: 1 Time: 0.05558 [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:23] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:50:23] [V] [TRT] Tactic: 254850674756030979 Time: 0.024576 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1156328698016730421 Time: 0.016384 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017692 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1576319725282257846 Time: 0.012228 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01188 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011872 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:50:23] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009676 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2238656696610018305 Time: 0.01226 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2541579301352125276 Time: 0.016512 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025452 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:50:23] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009208 [05/21/2021-05:50:23] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:50:24] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011264 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3071479995783211391 Time: 0.007936 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011364 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3362537467505018070 Time: 0.016428 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3513075359009385578 Time: 0.025992 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016788 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:50:24] [V] [TRT] Tactic: 3899310434460415852 Time: 0.008364 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011412 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4370476717970497892 Time: 0.011268 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4480294673430783793 Time: 0.011136 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4491683531415781597 Time: 0.023552 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01444 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4571819373777460444 Time: 0.024848 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4595173549602041350 Time: 0.023552 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4802447371470387646 Time: 0.016796 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:50:24] [V] [TRT] Tactic: 4993757826442493905 Time: 0.011028 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:50:24] [V] [TRT] Tactic: 5059676457552313631 Time: 0.02538 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:50:24] [V] [TRT] Tactic: 5205510332404400949 Time: 0.01612 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:50:24] [V] [TRT] Tactic: 5346855796032465921 Time: 0.016992 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:50:24] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016908 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:50:24] [V] [TRT] Tactic: 6034364043891107501 Time: 0.011036 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:50:24] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0154 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:50:24] [V] [TRT] Tactic: 6468794451065529747 Time: 0.012296 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:24] [V] [TRT] Tactic: 6697277555581639516 Time: 0.011264 [05/21/2021-05:50:24] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:50:24] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009168 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:50:25] [V] [TRT] Tactic: 7216571380637776659 Time: 0.018688 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:50:25] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011624 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:50:25] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009708 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:50:25] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01218 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:50:25] [V] [TRT] Tactic: 8764780417487154889 Time: 0.016156 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:50:25] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010228 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:50:25] [V] [TRT] Tactic: 8839784824303350101 Time: 0.01728 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:25] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00926 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:50:25] [V] [TRT] Tactic: -9009272790678027912 Time: 0.01794 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:50:25] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009504 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:50:25] [V] [TRT] Tactic: -8280443484414412687 Time: 0.02496 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:50:25] [V] [TRT] Tactic: -8205952393017864204 Time: 0.025284 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:50:25] [V] [TRT] Tactic: -8131857373260504832 Time: 0.01024 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:50:25] [V] [TRT] Tactic: -7410012245391920273 Time: 0.009984 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:50:25] [V] [TRT] Tactic: -7099920365135295801 Time: 0.010736 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:50:25] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00896 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:25] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01636 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:50:25] [V] [TRT] Tactic: -6356316196810535311 Time: 0.010236 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:50:25] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011632 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:50:25] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016244 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:25] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00824 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:50:25] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011268 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:50:25] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01034 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008448 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4796511246675321840 Time: 0.012416 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00936 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011344 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4293222705763522367 Time: 0.008664 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4152066959007262150 Time: 0.025436 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:50:25] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011392 [05/21/2021-05:50:25] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011856 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3905653247016903130 Time: 0.016404 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3903342530518878192 Time: 0.015324 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3864869056275745423 Time: 0.015744 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00912 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:50:26] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011648 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:50:26] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016288 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:50:26] [V] [TRT] Tactic: -2602982885923184927 Time: 0.015632 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:50:26] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01672 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:50:26] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011648 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:50:26] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010972 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1985778916402815946 Time: 0.016512 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1828674067637788567 Time: 0.007936 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011244 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1562548049711204899 Time: 0.016588 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1242202084391243207 Time: 0.01152 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009244 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:50:26] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011292 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:50:26] [V] [TRT] Tactic: -406984317033388136 Time: 0.016548 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:50:26] [V] [TRT] Tactic: -331499326992534460 Time: 0.010888 [05/21/2021-05:50:26] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:50:26] [V] [TRT] Tactic: -206523504474952360 Time: 0.016508 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.007936 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution) [05/21/2021-05:50:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Tactic: 0 Time: 0.0041 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 0 Time: 0.0041 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Tactic: 0 Time: 0.004624 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004624 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Tactic: 0 Time: 0.004788 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004788 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(25088,1,3584,512) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(6272,1:4,896,128) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(12544,49:2,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CublasConvolution) [05/21/2021-05:50:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(3136,1:8,448,64) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(1568,1:16,224,32) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CublasConvolution) [05/21/2021-05:50:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(25088,1,3584,512) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(6272,1:4,896,128) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(12544,49:2,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(25088,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(3136,1:8,448,64) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(1568,1:16,224,32) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1), Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CublasConvolution) [05/21/2021-05:50:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CudnnConvolution) [05/21/2021-05:50:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CublasConvolution) [05/21/2021-05:50:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CaskConvolution) [05/21/2021-05:50:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:26] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:26] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:26] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) *************** [05/21/2021-05:50:26] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.004864 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004864 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.004992 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004992 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.005228 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.005228 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale) [05/21/2021-05:50:27] [V] [TRT] Scale has no valid tactics for this config, skipping [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(2048,1,1,1) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: 8192257 Time: 0.005248 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8257793 Time: 0.005248 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8323329 Time: 0.005504 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8388865 Time: 0.005188 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8454401 Time: 0.005512 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8519937 Time: 0.00576 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8585473 Time: 0.005548 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8651009 Time: 0.005504 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 8388865 Time: 0.005188 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: -1 Time: 0.005632 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: -1 Time: 0.005632 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8388865 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(2048,1,1,1) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling) [05/21/2021-05:50:27] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: -1 Time: 0.005888 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: -1 Time: 0.005888 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(1024,1:2,1,1) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: 8192257 Time: 0.004736 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8257793 Time: 0.004868 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8323329 Time: 0.005268 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8388865 Time: 0.005424 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8454401 Time: 0.005516 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8519937 Time: 0.006016 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8585473 Time: 0.006784 [05/21/2021-05:50:27] [V] [TRT] Tactic: 8651009 Time: 0.006784 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 8192257 Time: 0.004736 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (CudaPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: -3 Time: 0.00736 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: -3 Time: 0.00736 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8192257 [05/21/2021-05:50:27] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(256,1:8,256,256) *************** [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling) [05/21/2021-05:50:27] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (CudaPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: -2 Time: 0.007168 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: -2 Time: 0.007168 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling) [05/21/2021-05:50:27] [V] [TRT] Tactic: -1 Time: 0.005364 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: -1 Time: 0.005364 [05/21/2021-05:50:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.005272 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.004148 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004148 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.00704 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.006252 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.003824 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003824 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.006044 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.003564 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.003564 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.005828 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.00388 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00388 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.006016 [05/21/2021-05:50:27] [V] [TRT] Tactic: 0 Time: 0.004192 [05/21/2021-05:50:27] [V] [TRT] Fastest Tactic: 0 Time: 0.004192 [05/21/2021-05:50:27] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:27] [V] [TRT] Tactic: 1002 Time: 0.005632 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004016 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004016 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.00594 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004128 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004128 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005508 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004068 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004068 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006136 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004088 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004088 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005308 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004032 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.00512 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003788 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003788 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006144 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003604 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003604 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005632 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003832 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003832 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006912 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.00448 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00448 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006412 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004416 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004416 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005544 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004048 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004048 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005688 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004116 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004116 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006368 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003856 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003856 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004068 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004068 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.00674 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004164 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004164 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006016 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003116 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003116 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005248 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.0032 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005376 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003152 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003152 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.007168 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.00362 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00362 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004312 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004312 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004304 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004304 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006784 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003408 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003408 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003712 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006352 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.0043 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0043 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006532 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003712 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.0055 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003652 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003652 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.00512 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003376 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003376 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005376 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.003072 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005872 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.00384 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00384 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(128,1:16,128,128) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.00594 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006656 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004096 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(2048,1,2048,2048) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.0059 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004216 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004216 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(512,1:4,512,512) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.005804 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004252 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004252 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(2048,1,1,1) (Reformat) [05/21/2021-05:50:28] [V] [TRT] Tactic: 1002 Time: 0.006472 [05/21/2021-05:50:28] [V] [TRT] Tactic: 0 Time: 0.004044 [05/21/2021-05:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004044 [05/21/2021-05:50:28] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(1024,1:2,1,1) (Reformat) [05/21/2021-05:50:29] [V] [TRT] Tactic: 1002 Time: 0.006708 [05/21/2021-05:50:29] [V] [TRT] Tactic: 0 Time: 0.0042 [05/21/2021-05:50:29] [V] [TRT] Fastest Tactic: 0 Time: 0.0042 [05/21/2021-05:50:29] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(256,1:8,256,256) (Reformat) [05/21/2021-05:50:29] [V] [TRT] Tactic: 1002 Time: 0.005916 [05/21/2021-05:50:29] [V] [TRT] Tactic: 0 Time: 0.00406 [05/21/2021-05:50:29] [V] [TRT] Fastest Tactic: 0 Time: 0.00406 [05/21/2021-05:50:29] [V] [TRT] *************** Autotuning format combination: Float(2048,1,1,1) -> Float(1000,1,1,1) *************** [05/21/2021-05:50:29] [V] [TRT] --------------- Timing Runner: fc1 (CudaDepthwiseConvolution) [05/21/2021-05:50:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:29] [V] [TRT] --------------- Timing Runner: fc1 (FusedConvActConvolution) [05/21/2021-05:50:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:29] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:29] [V] [TRT] Tactic: 0 Time: 0.129696 [05/21/2021-05:50:29] [V] [TRT] Tactic: 1 Time: 0.091548 [05/21/2021-05:50:29] [V] [TRT] Tactic: 2 Time: 0.149916 [05/21/2021-05:50:29] [V] [TRT] Tactic: 4 Time: 9.16921 [05/21/2021-05:50:29] [V] [TRT] Tactic: 5 Time: 0.812132 [05/21/2021-05:50:29] [V] [TRT] Tactic: 56 Time: 0.132824 [05/21/2021-05:50:29] [V] [TRT] Tactic: 57 Time: 0.093712 [05/21/2021-05:50:29] [V] [TRT] Tactic: 58 Time: 0.15592 [05/21/2021-05:50:29] [V] [TRT] Tactic: 60 Time: 7.97814 [05/21/2021-05:50:29] [V] [TRT] Tactic: 61 Time: 0.812944 [05/21/2021-05:50:29] [V] [TRT] Tactic: 112 Time: 0.1332 [05/21/2021-05:50:29] [V] [TRT] Tactic: 113 Time: 0.094008 [05/21/2021-05:50:29] [V] [TRT] Tactic: 114 Time: 0.15606 [05/21/2021-05:50:29] [V] [TRT] Tactic: 116 Time: 7.97502 [05/21/2021-05:50:29] [V] [TRT] Tactic: 117 Time: 0.81184 [05/21/2021-05:50:29] [V] [TRT] Fastest Tactic: 1 Time: 0.091548 [05/21/2021-05:50:29] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:30] [V] [TRT] Tactic: 0 Time: 0.016848 [05/21/2021-05:50:30] [V] [TRT] Tactic: 1 Time: 0.01808 [05/21/2021-05:50:30] [V] [TRT] Tactic: 2 Time: 0.0225 [05/21/2021-05:50:30] [V] [TRT] Tactic: 3 Time: 0.027776 [05/21/2021-05:50:30] [V] [TRT] Fastest Tactic: 0 Time: 0.016848 [05/21/2021-05:50:30] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195 [05/21/2021-05:50:30] [V] [TRT] Tactic: 4549827808004681195 Time: 0.177152 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575 [05/21/2021-05:50:30] [V] [TRT] Tactic: 5779835512569528575 Time: 0.224256 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840 [05/21/2021-05:50:30] [V] [TRT] Tactic: 9151672657204310840 Time: 0.188672 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098 [05/21/2021-05:50:30] [V] [TRT] Tactic: -7491730084094677098 Time: 0.208804 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845 [05/21/2021-05:50:30] [V] [TRT] Tactic: -6622064180404051845 Time: 0.177392 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184 [05/21/2021-05:50:30] [V] [TRT] Tactic: -6313876406580483184 Time: 0.212972 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572 [05/21/2021-05:50:30] [V] [TRT] Tactic: -6273689210331812572 Time: 0.218996 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: -6194327789991425125 [05/21/2021-05:50:30] [V] [TRT] Tactic: -6194327789991425125 Time: 0.018552 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177 [05/21/2021-05:50:30] [V] [TRT] Tactic: -4337126844824617177 Time: 0.162048 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786 [05/21/2021-05:50:30] [V] [TRT] Tactic: -1123676555321336786 Time: 0.222076 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327 [05/21/2021-05:50:30] [V] [TRT] Tactic: -701551393537224327 Time: 0.186796 [05/21/2021-05:50:30] [V] [TRT] Fastest Tactic: -6194327789991425125 Time: 0.018552 [05/21/2021-05:50:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CublasConvolution Tactic: 0 [05/21/2021-05:50:30] [V] [TRT] *************** Autotuning format combination: Float(2048,1,2048,2048) -> Float(1000,1,1000,1000) *************** [05/21/2021-05:50:30] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:30] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:30] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:30] [V] [TRT] Tactic: 1663866669559596164 Time: 0.220488 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:30] [V] [TRT] Tactic: 2860655430572478466 Time: 0.133432 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:30] [V] [TRT] Tactic: 4474630279712975759 Time: 0.07354 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:30] [V] [TRT] Tactic: 4479823862704990365 Time: 0.072236 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:30] [V] [TRT] Tactic: 4696204239951173149 Time: 0.129892 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:30] [V] [TRT] Tactic: 5778138195697110003 Time: 0.222224 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:30] [V] [TRT] Tactic: 8918020581761223752 Time: 0.214272 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:30] [V] [TRT] Tactic: -5905193483742532701 Time: 0.115356 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:30] [V] [TRT] Tactic: -4035591156787122265 Time: 0.071324 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:30] [V] [TRT] Tactic: -2809379259463049391 Time: 0.220296 [05/21/2021-05:50:30] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:31] [V] [TRT] Tactic: -1985235291706575900 Time: 0.21466 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:31] [V] [TRT] Tactic: -504296718212024303 Time: 0.217 [05/21/2021-05:50:31] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.071324 [05/21/2021-05:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:31] [V] [TRT] *************** Autotuning format combination: Float(512,1:4,512,512) -> Float(250,1:4,250,250) *************** [05/21/2021-05:50:31] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:31] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:31] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411 [05/21/2021-05:50:31] [V] [TRT] Tactic: 1373022415249282411 Time: 0.152192 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164 [05/21/2021-05:50:31] [V] [TRT] Tactic: 1663866669559596164 Time: 0.2208 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466 [05/21/2021-05:50:31] [V] [TRT] Tactic: 2860655430572478466 Time: 0.133516 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759 [05/21/2021-05:50:31] [V] [TRT] Tactic: 4474630279712975759 Time: 0.073588 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365 [05/21/2021-05:50:31] [V] [TRT] Tactic: 4479823862704990365 Time: 0.071604 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149 [05/21/2021-05:50:31] [V] [TRT] Tactic: 4696204239951173149 Time: 0.129328 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003 [05/21/2021-05:50:31] [V] [TRT] Tactic: 5778138195697110003 Time: 0.222336 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752 [05/21/2021-05:50:31] [V] [TRT] Tactic: 8918020581761223752 Time: 0.213888 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014 [05/21/2021-05:50:31] [V] [TRT] Tactic: -7067026478815706014 Time: 0.151964 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701 [05/21/2021-05:50:31] [V] [TRT] Tactic: -5905193483742532701 Time: 0.116224 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265 [05/21/2021-05:50:31] [V] [TRT] Tactic: -4035591156787122265 Time: 0.071208 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391 [05/21/2021-05:50:31] [V] [TRT] Tactic: -2809379259463049391 Time: 0.2203 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900 [05/21/2021-05:50:31] [V] [TRT] Tactic: -1985235291706575900 Time: 0.214656 [05/21/2021-05:50:31] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303 [05/21/2021-05:50:31] [V] [TRT] Tactic: -504296718212024303 Time: 0.21696 [05/21/2021-05:50:31] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.071208 [05/21/2021-05:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265 [05/21/2021-05:50:31] [V] [TRT] *************** Autotuning format combination: Half(2048,1,1,1) -> Half(1000,1,1,1) *************** [05/21/2021-05:50:31] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:31] [V] [TRT] Tactic: 0 Time: 1.11601 [05/21/2021-05:50:31] [V] [TRT] Tactic: 1 Time: 0.179456 [05/21/2021-05:50:31] [V] [TRT] Tactic: 2 Time: 0.132192 [05/21/2021-05:50:31] [V] [TRT] Tactic: 4 Time: 7.90621 [05/21/2021-05:50:31] [V] [TRT] Tactic: 5 Time: 0.77524 [05/21/2021-05:50:31] [V] [TRT] Tactic: 56 Time: 1.11526 [05/21/2021-05:50:31] [V] [TRT] Tactic: 58 Time: 0.132308 [05/21/2021-05:50:31] [V] [TRT] Tactic: 60 Time: 7.91532 [05/21/2021-05:50:31] [V] [TRT] Tactic: 61 Time: 0.777168 [05/21/2021-05:50:31] [V] [TRT] Fastest Tactic: 2 Time: 0.132192 [05/21/2021-05:50:31] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:31] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Tactic: 0 Time: 8.44902 [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo [05/21/2021-05:50:32] [V] [TRT] Tactic: 1 Time: 9.83619 [05/21/2021-05:50:32] [V] [TRT] Tactic: 2 Time: 0.025228 [05/21/2021-05:50:32] [V] [TRT] Tactic: 3 Time: 0.024064 [05/21/2021-05:50:32] [V] [TRT] Tactic: 4 Time: 0.020352 [05/21/2021-05:50:32] [V] [TRT] Tactic: 5 Time: 0.019616 [05/21/2021-05:50:32] [V] [TRT] Tactic: 6 Time: 0.015616 [05/21/2021-05:50:32] [V] [TRT] Tactic: 7 Time: 0.01536 [05/21/2021-05:50:32] [V] [TRT] Fastest Tactic: 7 Time: 0.01536 [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CublasConvolution Tactic: 7 [05/21/2021-05:50:32] [V] [TRT] *************** Autotuning format combination: Half(1024,1:2,1,1) -> Half(1000,1,1,1) *************** [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: sm70_xmma_fprop_conv1x1_f16f16_f16_f16_nchw_vect_c_2kcrs_vect_c_2_nchw_simt_small_batch_bias_relu Tactic: -7852373803729529742 [05/21/2021-05:50:32] [V] [TRT] Tactic: -7852373803729529742 Time: 0.018468 [05/21/2021-05:50:32] [V] [TRT] Fastest Tactic: -7852373803729529742 Time: 0.018468 [05/21/2021-05:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7852373803729529742 [05/21/2021-05:50:32] [V] [TRT] *************** Autotuning format combination: Half(1024,1:2,1,1) -> Half(500,1:2,1,1) *************** [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (FusedConvActConvolution) [05/21/2021-05:50:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453 [05/21/2021-05:50:32] [V] [TRT] Tactic: 2195670545862694453 Time: 0.105732 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536 [05/21/2021-05:50:32] [V] [TRT] Tactic: 3891805945559659536 Time: 0.145808 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714 [05/21/2021-05:50:32] [V] [TRT] Tactic: 4418200634486186714 Time: 0.086656 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555 [05/21/2021-05:50:32] [V] [TRT] Tactic: 5548126322150286555 Time: 0.097332 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508 [05/21/2021-05:50:32] [V] [TRT] Tactic: 6057304366605292508 Time: 0.09204 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811 [05/21/2021-05:50:32] [V] [TRT] Tactic: 7392644644614664811 Time: 0.08832 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293 [05/21/2021-05:50:32] [V] [TRT] Tactic: -4884039206922900293 Time: 0.142336 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161 [05/21/2021-05:50:32] [V] [TRT] Tactic: -4374269919094467161 Time: 0.088528 [05/21/2021-05:50:32] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867 [05/21/2021-05:50:32] [V] [TRT] Tactic: -1546027692247304867 Time: 0.146688 [05/21/2021-05:50:32] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.086656 [05/21/2021-05:50:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714 [05/21/2021-05:50:32] [V] [TRT] *************** Autotuning format combination: Half(256,1:8,256,256) -> Float(1000,1,1,1) *************** [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] *************** Autotuning format combination: Half(256,1:8,256,256) -> Half(125,1:8,125,125) *************** [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CudaDepthwiseConvolution) [05/21/2021-05:50:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:32] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:32] [V] [TRT] Tactic: 0 Time: 1.12389 [05/21/2021-05:50:32] [V] [TRT] Tactic: 1 Time: 0.179304 [05/21/2021-05:50:32] [V] [TRT] Tactic: 2 Time: 0.131968 [05/21/2021-05:50:32] [V] [TRT] Tactic: 4 Time: 7.91852 [05/21/2021-05:50:32] [V] [TRT] Tactic: 5 Time: 0.776408 [05/21/2021-05:50:32] [V] [TRT] Tactic: 56 Time: 1.11821 [05/21/2021-05:50:32] [V] [TRT] Tactic: 58 Time: 0.132224 [05/21/2021-05:50:33] [V] [TRT] Tactic: 60 Time: 7.93041 [05/21/2021-05:50:33] [V] [TRT] Tactic: 61 Time: 0.776796 [05/21/2021-05:50:33] [V] [TRT] Fastest Tactic: 2 Time: 0.131968 [05/21/2021-05:50:33] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:33] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979 [05/21/2021-05:50:33] [V] [TRT] Tactic: 254850674756030979 Time: 0.077948 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0468 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1362727228442059924 Time: 0.04662 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1576319725282257846 Time: 0.02358 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1832046141070096030 Time: 0.023668 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1838082074606840426 Time: 0.024912 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472 [05/21/2021-05:50:33] [V] [TRT] Tactic: 1899296423087490472 Time: 0.015916 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305 [05/21/2021-05:50:33] [V] [TRT] Tactic: 2238656696610018305 Time: 0.024604 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276 [05/21/2021-05:50:33] [V] [TRT] Tactic: 2541579301352125276 Time: 0.045744 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085 [05/21/2021-05:50:33] [V] [TRT] Tactic: 2559328254295148085 Time: 0.075776 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609 [05/21/2021-05:50:33] [V] [TRT] Tactic: 2657157263811141609 Time: 0.015976 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194 [05/21/2021-05:50:33] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0247 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010432 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3359475309458902373 Time: 0.022496 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3362537467505018070 Time: 0.040932 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3513075359009385578 Time: 0.078516 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3704534001553878387 Time: 0.044444 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:50:33] [V] [TRT] Tactic: 3899310434460415852 Time: 0.014936 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4278315135102886928 Time: 0.024284 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4370476717970497892 Time: 0.023724 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4480294673430783793 Time: 0.023676 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4491683531415781597 Time: 0.07552 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4528997467275241200 Time: 0.041088 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4571819373777460444 Time: 0.07784 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4595173549602041350 Time: 0.075596 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4802447371470387646 Time: 0.04224 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905 [05/21/2021-05:50:33] [V] [TRT] Tactic: 4993757826442493905 Time: 0.022464 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631 [05/21/2021-05:50:33] [V] [TRT] Tactic: 5059676457552313631 Time: 0.07656 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949 [05/21/2021-05:50:33] [V] [TRT] Tactic: 5205510332404400949 Time: 0.040012 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921 [05/21/2021-05:50:33] [V] [TRT] Tactic: 5346855796032465921 Time: 0.04226 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893 [05/21/2021-05:50:33] [V] [TRT] Tactic: 5398999388616959893 Time: 0.044048 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501 [05/21/2021-05:50:33] [V] [TRT] Tactic: 6034364043891107501 Time: 0.023992 [05/21/2021-05:50:33] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891 [05/21/2021-05:50:34] [V] [TRT] Tactic: 6377497238381488891 Time: 0.04182 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747 [05/21/2021-05:50:34] [V] [TRT] Tactic: 6468794451065529747 Time: 0.025192 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:34] [V] [TRT] Tactic: 6697277555581639516 Time: 0.023692 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460 [05/21/2021-05:50:34] [V] [TRT] Tactic: 6859477213531075460 Time: 0.016044 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659 [05/21/2021-05:50:34] [V] [TRT] Tactic: 7216571380637776659 Time: 0.055004 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135 [05/21/2021-05:50:34] [V] [TRT] Tactic: 7609923741161019135 Time: 0.024584 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805 [05/21/2021-05:50:34] [V] [TRT] Tactic: 8101703987960976805 Time: 0.015488 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895 [05/21/2021-05:50:34] [V] [TRT] Tactic: 8170606396342855895 Time: 0.023552 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889 [05/21/2021-05:50:34] [V] [TRT] Tactic: 8764780417487154889 Time: 0.04252 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606 [05/21/2021-05:50:34] [V] [TRT] Tactic: 8823554289762712606 Time: 0.022132 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101 [05/21/2021-05:50:34] [V] [TRT] Tactic: 8839784824303350101 Time: 0.051476 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:34] [V] [TRT] Tactic: -9203179519031456182 Time: 0.01792 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912 [05/21/2021-05:50:34] [V] [TRT] Tactic: -9009272790678027912 Time: 0.053236 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024 [05/21/2021-05:50:34] [V] [TRT] Tactic: -8604374562669615024 Time: 0.016372 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687 [05/21/2021-05:50:34] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0768 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204 [05/21/2021-05:50:34] [V] [TRT] Tactic: -8205952393017864204 Time: 0.075392 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832 [05/21/2021-05:50:34] [V] [TRT] Tactic: -8131857373260504832 Time: 0.023936 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273 [05/21/2021-05:50:34] [V] [TRT] Tactic: -7410012245391920273 Time: 0.016024 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801 [05/21/2021-05:50:34] [V] [TRT] Tactic: -7099920365135295801 Time: 0.02196 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395 [05/21/2021-05:50:34] [V] [TRT] Tactic: -7089118800560870395 Time: 0.01472 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:34] [V] [TRT] Tactic: -6768327495007644783 Time: 0.040984 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311 [05/21/2021-05:50:34] [V] [TRT] Tactic: -6356316196810535311 Time: 0.017316 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211 [05/21/2021-05:50:34] [V] [TRT] Tactic: -6063766379489217211 Time: 0.02464 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586 [05/21/2021-05:50:34] [V] [TRT] Tactic: -5530886555766748586 Time: 0.04556 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:34] [V] [TRT] Tactic: -5409588854490562130 Time: 0.017908 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102 [05/21/2021-05:50:34] [V] [TRT] Tactic: -5161596964442251102 Time: 0.024704 [05/21/2021-05:50:34] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006 [05/21/2021-05:50:34] [V] [TRT] Tactic: -5127240325355316006 Time: 0.023976 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01536 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4796511246675321840 Time: 0.024812 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4548822885169694805 Time: 0.015632 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4379519430184503304 Time: 0.023576 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4293222705763522367 Time: 0.014336 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4152066959007262150 Time: 0.077988 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549 [05/21/2021-05:50:35] [V] [TRT] Tactic: -4021926646879732549 Time: 0.02424 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3987638434926559037 Time: 0.024988 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3905653247016903130 Time: 0.045024 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3903342530518878192 Time: 0.046052 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3864869056275745423 Time: 0.04712 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3601464762214218301 Time: 0.015872 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555 [05/21/2021-05:50:35] [V] [TRT] Tactic: -3058330359340425555 Time: 0.023552 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856 [05/21/2021-05:50:35] [V] [TRT] Tactic: -2878731503146438856 Time: 0.040064 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927 [05/21/2021-05:50:35] [V] [TRT] Tactic: -2602982885923184927 Time: 0.040448 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338 [05/21/2021-05:50:35] [V] [TRT] Tactic: -2353603993968373338 Time: 0.050432 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150 [05/21/2021-05:50:35] [V] [TRT] Tactic: -2032577876140256150 Time: 0.02514 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050 [05/21/2021-05:50:35] [V] [TRT] Tactic: -2003055242756584050 Time: 0.023744 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1985778916402815946 Time: 0.04898 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1828674067637788567 Time: 0.012532 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1640527254204634147 Time: 0.024704 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1562548049711204899 Time: 0.041764 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1242202084391243207 Time: 0.023868 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1099247066487349374 Time: 0.015352 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549 [05/21/2021-05:50:35] [V] [TRT] Tactic: -1038291877007553549 Time: 0.022756 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136 [05/21/2021-05:50:35] [V] [TRT] Tactic: -406984317033388136 Time: 0.042104 [05/21/2021-05:50:35] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460 [05/21/2021-05:50:36] [V] [TRT] Tactic: -331499326992534460 Time: 0.023888 [05/21/2021-05:50:36] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360 [05/21/2021-05:50:36] [V] [TRT] Tactic: -206523504474952360 Time: 0.042112 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.010432 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Half(128,1:16,128,128) -> Half(63,1:16,63,63) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution) [05/21/2021-05:50:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution) [05/21/2021-05:50:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution) [05/21/2021-05:50:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1,1) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.005964 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.00388 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00388 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1000,1000) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.005504 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.004076 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004076 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1000,1000) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.00556 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.00336 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(250,1:4,250,250) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006156 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003616 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003616 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(250,1:4,250,250) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.005376 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003652 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003652 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1,1,1) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003692 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003692 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(500,1:2,1,1) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.007172 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003712 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003712 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(500,1:2,1,1) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006592 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003456 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(125,1:8,125,125) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.00336 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00336 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(125,1:8,125,125) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.00646 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003328 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003328 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(63,1:16,63,63) -> Float(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006272 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.004388 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004388 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(63,1:16,63,63) -> Half(1000,1,1,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.0064 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.004052 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004052 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Float(1000,1,1,1) -> Float(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [Shuffle] (Shuffle) [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.0032 [05/21/2021-05:50:36] [V] [TRT] Tactic: 1 Time: 0.008164 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0032 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Half(1000,1,1,1) -> Half(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [Shuffle] (Shuffle) [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003072 [05/21/2021-05:50:36] [V] [TRT] Tactic: 1 Time: 0.010232 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1) -> Half(1000,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.00512 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003688 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003688 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1) -> Float(1000,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003852 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003852 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Float(1000,1) -> Float(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: cast1 (Cast) [05/21/2021-05:50:36] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: cast1 (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.00638 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003456 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003456 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Half(1000,1) -> Float(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: cast1 (Cast) [05/21/2021-05:50:36] [V] [TRT] Cast has no valid tactics for this config, skipping [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: cast1 (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003624 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003624 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Float(1000,1) -> Float(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: softmax (CudaSoftMax) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1001 Time: 0.00448 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 1001 Time: 0.00448 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: softmax (CudnnSoftMax) [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.005504 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005504 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 1001 [05/21/2021-05:50:36] [V] [TRT] *************** Autotuning format combination: Half(1000,1) -> Half(1000,1) *************** [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: softmax (CudaSoftMax) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1001 Time: 0.004992 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 1001 Time: 0.004992 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: softmax (CudnnSoftMax) [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.005376 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005376 [05/21/2021-05:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 1001 [05/21/2021-05:50:36] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1) -> Float(1000,1) (Reformat) [05/21/2021-05:50:36] [V] [TRT] Tactic: 1002 Time: 0.006528 [05/21/2021-05:50:36] [V] [TRT] Tactic: 0 Time: 0.003664 [05/21/2021-05:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.003664 [05/21/2021-05:50:36] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1 (stage1_unit1_relu1) from Half(100352,3136:2,56,1) to Half(25088,1:8,448,8) [05/21/2021-05:50:36] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to (Unnamed Layer* 176) [Shuffle] ((Unnamed Layer* 175) [Fully Connected]_output) from Half(125,1:8,125,125) to Float(1000,1,1,1) [05/21/2021-05:50:36] [V] [TRT] For layer (Unnamed Layer* 176) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [05/21/2021-05:50:36] [V] [TRT] For layer softmax a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [05/21/2021-05:50:36] [V] [TRT] Formats and tactics selection completed in 220.202 seconds. [05/21/2021-05:50:36] [V] [TRT] After reformat layers: 80 layers [05/21/2021-05:50:36] [V] [TRT] Block size 8589934592 [05/21/2021-05:50:36] [V] [TRT] Block size 1605632 [05/21/2021-05:50:36] [V] [TRT] Block size 1605632 [05/21/2021-05:50:36] [V] [TRT] Block size 1605632 [05/21/2021-05:50:36] [V] [TRT] Block size 802816 [05/21/2021-05:50:36] [V] [TRT] Total Activation Memory: 8595554304 [05/21/2021-05:50:36] [I] [TRT] Detected 1 inputs and 1 output network tensors. [05/21/2021-05:50:36] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714 [05/21/2021-05:50:36] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:36] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:50:36] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899 [05/21/2021-05:50:36] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:36] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:36] [V] [TRT] stage1_unit2_conv2 + stage1_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:50:36] [V] [TRT] stage1_unit2_conv3 + _plus1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:36] [V] [TRT] stage1_unit3_conv1 + stage1_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:36] [V] [TRT] stage1_unit3_conv2 + stage1_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682 [05/21/2021-05:50:36] [V] [TRT] stage1_unit3_conv3 + _plus2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783 [05/21/2021-05:50:36] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793 [05/21/2021-05:50:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:36] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:36] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435 [05/21/2021-05:50:36] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:36] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:36] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:36] [V] [TRT] stage2_unit3_conv1 + stage2_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:36] [V] [TRT] stage2_unit3_conv2 + stage2_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:36] [V] [TRT] stage2_unit3_conv3 + _plus5 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:37] [V] [TRT] stage2_unit4_conv1 + stage2_unit4_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:37] [V] [TRT] stage2_unit4_conv2 + stage2_unit4_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage2_unit4_conv3 + _plus6 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516 [05/21/2021-05:50:37] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:37] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182 [05/21/2021-05:50:37] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944 [05/21/2021-05:50:37] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:37] [V] [TRT] stage3_unit3_conv1 + stage3_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage3_unit3_conv2 + stage3_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit3_conv3 + _plus9 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:37] [V] [TRT] stage3_unit4_conv1 + stage3_unit4_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage3_unit4_conv2 + stage3_unit4_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit4_conv3 + _plus10 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:37] [V] [TRT] stage3_unit5_conv1 + stage3_unit5_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage3_unit5_conv2 + stage3_unit5_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit5_conv3 + _plus11 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:37] [V] [TRT] stage3_unit6_conv1 + stage3_unit6_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage3_unit6_conv2 + stage3_unit6_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage3_unit6_conv3 + _plus12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130 [05/21/2021-05:50:37] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:50:37] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166 [05/21/2021-05:50:37] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852 [05/21/2021-05:50:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367 [05/21/2021-05:50:37] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:37] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:50:37] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] stage4_unit3_conv1 + stage4_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567 [05/21/2021-05:50:37] [V] [TRT] stage4_unit3_conv2 + stage4_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096 [05/21/2021-05:50:37] [V] [TRT] stage4_unit3_conv3 + _plus15 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391 [05/21/2021-05:50:37] [V] [TRT] Layer: cast0 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: bn_data HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: conv0 + relu0 HostPersistent: 4224 DevicePersistent: 100864 [05/21/2021-05:50:37] [V] [TRT] Layer: pooling0 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit1_bn1 + stage1_unit1_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit1_conv1 + stage1_unit1_relu2 HostPersistent: 3776 DevicePersistent: 8704 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit1_conv2 + stage1_unit1_relu3 HostPersistent: 3776 DevicePersistent: 74240 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit1_conv3 HostPersistent: 3776 DevicePersistent: 34816 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit1_sc + _plus0 HostPersistent: 3776 DevicePersistent: 34816 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit2_bn1 + stage1_unit2_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit2_conv1 + stage1_unit2_relu2 HostPersistent: 3776 DevicePersistent: 33280 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit2_conv2 + stage1_unit2_relu3 HostPersistent: 3776 DevicePersistent: 74240 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit2_conv3 + _plus1 HostPersistent: 3776 DevicePersistent: 34816 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit3_bn1 + stage1_unit3_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit3_conv1 + stage1_unit3_relu2 HostPersistent: 3776 DevicePersistent: 33280 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit3_conv2 + stage1_unit3_relu3 HostPersistent: 3776 DevicePersistent: 74240 [05/21/2021-05:50:37] [V] [TRT] Layer: stage1_unit3_conv3 + _plus2 HostPersistent: 3776 DevicePersistent: 34816 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit1_bn1 + stage2_unit1_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit1_conv1 + stage2_unit1_relu2 HostPersistent: 3776 DevicePersistent: 66560 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit1_conv2 + stage2_unit1_relu3 HostPersistent: 3776 DevicePersistent: 295936 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit1_conv3 HostPersistent: 3776 DevicePersistent: 135168 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit1_sc + _plus3 HostPersistent: 3776 DevicePersistent: 266240 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit2_bn1 + stage2_unit2_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit2_conv1 + stage2_unit2_relu2 HostPersistent: 3776 DevicePersistent: 132096 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit2_conv2 + stage2_unit2_relu3 HostPersistent: 3776 DevicePersistent: 295936 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit2_conv3 + _plus4 HostPersistent: 3776 DevicePersistent: 135168 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit3_bn1 + stage2_unit3_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit3_conv1 + stage2_unit3_relu2 HostPersistent: 3776 DevicePersistent: 132096 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit3_conv2 + stage2_unit3_relu3 HostPersistent: 3776 DevicePersistent: 295936 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit3_conv3 + _plus5 HostPersistent: 3776 DevicePersistent: 135168 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit4_bn1 + stage2_unit4_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit4_conv1 + stage2_unit4_relu2 HostPersistent: 3776 DevicePersistent: 132096 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit4_conv2 + stage2_unit4_relu3 HostPersistent: 3776 DevicePersistent: 295936 [05/21/2021-05:50:37] [V] [TRT] Layer: stage2_unit4_conv3 + _plus6 HostPersistent: 3776 DevicePersistent: 135168 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit1_bn1 + stage3_unit1_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit1_conv1 + stage3_unit1_relu2 HostPersistent: 3776 DevicePersistent: 263680 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit1_conv2 + stage3_unit1_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit1_conv3 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit1_sc + _plus7 HostPersistent: 2496 DevicePersistent: 1056768 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit2_bn1 + stage3_unit2_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit2_conv1 + stage3_unit2_relu2 HostPersistent: 3776 DevicePersistent: 525824 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit2_conv2 + stage3_unit2_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit2_conv3 + _plus8 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit3_bn1 + stage3_unit3_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit3_conv1 + stage3_unit3_relu2 HostPersistent: 3776 DevicePersistent: 525824 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit3_conv2 + stage3_unit3_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit3_conv3 + _plus9 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit4_bn1 + stage3_unit4_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit4_conv1 + stage3_unit4_relu2 HostPersistent: 3776 DevicePersistent: 525824 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit4_conv2 + stage3_unit4_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit4_conv3 + _plus10 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit5_bn1 + stage3_unit5_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit5_conv1 + stage3_unit5_relu2 HostPersistent: 3776 DevicePersistent: 525824 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit5_conv2 + stage3_unit5_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit5_conv3 + _plus11 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit6_bn1 + stage3_unit6_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit6_conv1 + stage3_unit6_relu2 HostPersistent: 3776 DevicePersistent: 525824 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit6_conv2 + stage3_unit6_relu3 HostPersistent: 3776 DevicePersistent: 1181184 [05/21/2021-05:50:37] [V] [TRT] Layer: stage3_unit6_conv3 + _plus12 HostPersistent: 3776 DevicePersistent: 532480 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit1_bn1 + stage4_unit1_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit1_conv1 + stage4_unit1_relu2 HostPersistent: 3776 DevicePersistent: 1051648 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit1_conv2 + stage4_unit1_relu3 HostPersistent: 3776 DevicePersistent: 4721664 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit1_conv3 HostPersistent: 3776 DevicePersistent: 2113536 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit1_sc + _plus13 HostPersistent: 3200 DevicePersistent: 4194816 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit2_bn1 + stage4_unit2_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit2_conv1 + stage4_unit2_relu2 HostPersistent: 3776 DevicePersistent: 2100224 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit2_conv2 + stage4_unit2_relu3 HostPersistent: 3776 DevicePersistent: 4721664 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit2_conv3 + _plus14 HostPersistent: 3776 DevicePersistent: 2113536 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit3_bn1 + stage4_unit3_relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit3_conv1 + stage4_unit3_relu2 HostPersistent: 3776 DevicePersistent: 2100224 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit3_conv2 + stage4_unit3_relu3 HostPersistent: 3776 DevicePersistent: 4721664 [05/21/2021-05:50:37] [V] [TRT] Layer: stage4_unit3_conv3 + _plus15 HostPersistent: 3776 DevicePersistent: 2113536 [05/21/2021-05:50:37] [V] [TRT] Layer: bn1 + relu1 HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: pool1 HostPersistent: 48 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: fc1 HostPersistent: 3776 DevicePersistent: 4102144 [05/21/2021-05:50:37] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to (Unnamed Layer* 176) [Shuffle] HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [V] [TRT] Layer: softmax HostPersistent: 0 DevicePersistent: 0 [05/21/2021-05:50:37] [I] [TRT] Total Host Persistent Memory: 202544 [05/21/2021-05:50:37] [I] [TRT] Total Device Persistent Memory: 51277824 [05/21/2021-05:50:37] [I] [TRT] Total Scratch Memory: 0 [05/21/2021-05:50:37] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 112 MiB, GPU 4 MiB [05/21/2021-05:50:37] [V] [TRT] Using cublasLt a tactic source [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 2444, GPU 11594 (MiB) [05/21/2021-05:50:37] [V] [TRT] Using cuDNN as a tactic source [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +8, now: CPU 2445, GPU 11602 (MiB) [05/21/2021-05:50:37] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4 [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2445, GPU 11586 (MiB) [05/21/2021-05:50:37] [V] [TRT] Engine generation completed in 221.799 seconds. [05/21/2021-05:50:37] [V] [TRT] Deleting timing cache: 987 entries, 3800 hits [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2444, GPU 11568 (MiB) [05/21/2021-05:50:37] [V] [TRT] Engine Layer Information: Layer(Reformat): cast0, Tactic: 0, data[Float(1,3,224,224)] -> cast0[Half(1,3,224,224)] Layer(Scale): bn_data, Tactic: 0, cast0[Half(1,3,224,224)] -> bn_data[Half(1,3,224,224)] Layer(CaskConvolution): conv0 + relu0, Tactic: -5172391392092686714, bn_data[Half(1,3,224,224)] -> relu0[Half(1,64,112,112)] Layer(CudaPooling): pooling0, Tactic: -3, relu0[Half(1,64,112,112)] -> pooling0[Half(1,64,56,56)] Layer(Scale): stage1_unit1_bn1 + stage1_unit1_relu1, Tactic: 0, pooling0[Half(1,64,56,56)] -> Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1[Half(1,64,56,56)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1, Tactic: 0, Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1[Half(1,64,56,56)] -> stage1_unit1_relu1[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit1_conv1 + stage1_unit1_relu2, Tactic: -9203179519031456182, stage1_unit1_relu1[Half(1,64,56,56)] -> stage1_unit1_relu2[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit1_conv2 + stage1_unit1_relu3, Tactic: -910286698936744682, stage1_unit1_relu2[Half(1,64,56,56)] -> stage1_unit1_relu3[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit1_conv3, Tactic: -1562548049711204899, stage1_unit1_relu3[Half(1,64,56,56)] -> stage1_unit1_conv3[Half(1,256,56,56)] Layer(CaskConvolution): stage1_unit1_sc + _plus0, Tactic: -6768327495007644783, stage1_unit1_relu1[Half(1,64,56,56)], stage1_unit1_conv3[Half(1,256,56,56)] -> _plus0[Half(1,256,56,56)] Layer(Scale): stage1_unit2_bn1 + stage1_unit2_relu1, Tactic: 0, _plus0[Half(1,256,56,56)] -> stage1_unit2_relu1[Half(1,256,56,56)] Layer(CaskConvolution): stage1_unit2_conv1 + stage1_unit2_relu2, Tactic: -5409588854490562130, stage1_unit2_relu1[Half(1,256,56,56)] -> stage1_unit2_relu2[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit2_conv2 + stage1_unit2_relu3, Tactic: -910286698936744682, stage1_unit2_relu2[Half(1,64,56,56)] -> stage1_unit2_relu3[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit2_conv3 + _plus1, Tactic: -6768327495007644783, stage1_unit2_relu3[Half(1,64,56,56)], _plus0[Half(1,256,56,56)] -> _plus1[Half(1,256,56,56)] Layer(Scale): stage1_unit3_bn1 + stage1_unit3_relu1, Tactic: 0, _plus1[Half(1,256,56,56)] -> stage1_unit3_relu1[Half(1,256,56,56)] Layer(CaskConvolution): stage1_unit3_conv1 + stage1_unit3_relu2, Tactic: -5409588854490562130, stage1_unit3_relu1[Half(1,256,56,56)] -> stage1_unit3_relu2[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit3_conv2 + stage1_unit3_relu3, Tactic: -910286698936744682, stage1_unit3_relu2[Half(1,64,56,56)] -> stage1_unit3_relu3[Half(1,64,56,56)] Layer(CaskConvolution): stage1_unit3_conv3 + _plus2, Tactic: -6768327495007644783, stage1_unit3_relu3[Half(1,64,56,56)], _plus1[Half(1,256,56,56)] -> _plus2[Half(1,256,56,56)] Layer(Scale): stage2_unit1_bn1 + stage2_unit1_relu1, Tactic: 0, _plus2[Half(1,256,56,56)] -> stage2_unit1_relu1[Half(1,256,56,56)] Layer(CaskConvolution): stage2_unit1_conv1 + stage2_unit1_relu2, Tactic: 4480294673430783793, stage2_unit1_relu1[Half(1,256,56,56)] -> stage2_unit1_relu2[Half(1,128,56,56)] Layer(CaskConvolution): stage2_unit1_conv2 + stage2_unit1_relu3, Tactic: -6902925267326201166, stage2_unit1_relu2[Half(1,128,56,56)] -> stage2_unit1_relu3[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit1_conv3, Tactic: 6697277555581639516, stage2_unit1_relu3[Half(1,128,28,28)] -> stage2_unit1_conv3[Half(1,512,28,28)] Layer(CaskConvolution): stage2_unit1_sc + _plus3, Tactic: -4825567853927730435, stage2_unit1_relu1[Half(1,256,56,56)], stage2_unit1_conv3[Half(1,512,28,28)] -> _plus3[Half(1,512,28,28)] Layer(Scale): stage2_unit2_bn1 + stage2_unit2_relu1, Tactic: 0, _plus3[Half(1,512,28,28)] -> stage2_unit2_relu1[Half(1,512,28,28)] Layer(CaskConvolution): stage2_unit2_conv1 + stage2_unit2_relu2, Tactic: -1828674067637788567, stage2_unit2_relu1[Half(1,512,28,28)] -> stage2_unit2_relu2[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit2_conv2 + stage2_unit2_relu3, Tactic: -6902925267326201166, stage2_unit2_relu2[Half(1,128,28,28)] -> stage2_unit2_relu3[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit2_conv3 + _plus4, Tactic: 6697277555581639516, stage2_unit2_relu3[Half(1,128,28,28)], _plus3[Half(1,512,28,28)] -> _plus4[Half(1,512,28,28)] Layer(Scale): stage2_unit3_bn1 + stage2_unit3_relu1, Tactic: 0, _plus4[Half(1,512,28,28)] -> stage2_unit3_relu1[Half(1,512,28,28)] Layer(CaskConvolution): stage2_unit3_conv1 + stage2_unit3_relu2, Tactic: -1828674067637788567, stage2_unit3_relu1[Half(1,512,28,28)] -> stage2_unit3_relu2[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit3_conv2 + stage2_unit3_relu3, Tactic: -6902925267326201166, stage2_unit3_relu2[Half(1,128,28,28)] -> stage2_unit3_relu3[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit3_conv3 + _plus5, Tactic: 6697277555581639516, stage2_unit3_relu3[Half(1,128,28,28)], _plus4[Half(1,512,28,28)] -> _plus5[Half(1,512,28,28)] Layer(Scale): stage2_unit4_bn1 + stage2_unit4_relu1, Tactic: 0, _plus5[Half(1,512,28,28)] -> stage2_unit4_relu1[Half(1,512,28,28)] Layer(CaskConvolution): stage2_unit4_conv1 + stage2_unit4_relu2, Tactic: -1828674067637788567, stage2_unit4_relu1[Half(1,512,28,28)] -> stage2_unit4_relu2[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit4_conv2 + stage2_unit4_relu3, Tactic: -6902925267326201166, stage2_unit4_relu2[Half(1,128,28,28)] -> stage2_unit4_relu3[Half(1,128,28,28)] Layer(CaskConvolution): stage2_unit4_conv3 + _plus6, Tactic: 6697277555581639516, stage2_unit4_relu3[Half(1,128,28,28)], _plus5[Half(1,512,28,28)] -> _plus6[Half(1,512,28,28)] Layer(Scale): stage3_unit1_bn1 + stage3_unit1_relu1, Tactic: 0, _plus6[Half(1,512,28,28)] -> stage3_unit1_relu1[Half(1,512,28,28)] Layer(CaskConvolution): stage3_unit1_conv1 + stage3_unit1_relu2, Tactic: -9203179519031456182, stage3_unit1_relu1[Half(1,512,28,28)] -> stage3_unit1_relu2[Half(1,256,28,28)] Layer(CaskConvolution): stage3_unit1_conv2 + stage3_unit1_relu3, Tactic: -6902925267326201166, stage3_unit1_relu2[Half(1,256,28,28)] -> stage3_unit1_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit1_conv3, Tactic: -9203179519031456182, stage3_unit1_relu3[Half(1,256,14,14)] -> stage3_unit1_conv3[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit1_sc + _plus7, Tactic: 5368829646735632944, stage3_unit1_relu1[Half(1,512,28,28)], stage3_unit1_conv3[Half(1,1024,14,14)] -> _plus7[Half(1,1024,14,14)] Layer(Scale): stage3_unit2_bn1 + stage3_unit2_relu1, Tactic: 0, _plus7[Half(1,1024,14,14)] -> stage3_unit2_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit2_conv1 + stage3_unit2_relu2, Tactic: 3071479995783211391, stage3_unit2_relu1[Half(1,1024,14,14)] -> stage3_unit2_relu2[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit2_conv2 + stage3_unit2_relu3, Tactic: -6902925267326201166, stage3_unit2_relu2[Half(1,256,14,14)] -> stage3_unit2_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit2_conv3 + _plus8, Tactic: -5409588854490562130, stage3_unit2_relu3[Half(1,256,14,14)], _plus7[Half(1,1024,14,14)] -> _plus8[Half(1,1024,14,14)] Layer(Scale): stage3_unit3_bn1 + stage3_unit3_relu1, Tactic: 0, _plus8[Half(1,1024,14,14)] -> stage3_unit3_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit3_conv1 + stage3_unit3_relu2, Tactic: 3071479995783211391, stage3_unit3_relu1[Half(1,1024,14,14)] -> stage3_unit3_relu2[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit3_conv2 + stage3_unit3_relu3, Tactic: -6902925267326201166, stage3_unit3_relu2[Half(1,256,14,14)] -> stage3_unit3_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit3_conv3 + _plus9, Tactic: -5409588854490562130, stage3_unit3_relu3[Half(1,256,14,14)], _plus8[Half(1,1024,14,14)] -> _plus9[Half(1,1024,14,14)] Layer(Scale): stage3_unit4_bn1 + stage3_unit4_relu1, Tactic: 0, _plus9[Half(1,1024,14,14)] -> stage3_unit4_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit4_conv1 + stage3_unit4_relu2, Tactic: 3071479995783211391, stage3_unit4_relu1[Half(1,1024,14,14)] -> stage3_unit4_relu2[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit4_conv2 + stage3_unit4_relu3, Tactic: -6902925267326201166, stage3_unit4_relu2[Half(1,256,14,14)] -> stage3_unit4_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit4_conv3 + _plus10, Tactic: -5409588854490562130, stage3_unit4_relu3[Half(1,256,14,14)], _plus9[Half(1,1024,14,14)] -> _plus10[Half(1,1024,14,14)] Layer(Scale): stage3_unit5_bn1 + stage3_unit5_relu1, Tactic: 0, _plus10[Half(1,1024,14,14)] -> stage3_unit5_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit5_conv1 + stage3_unit5_relu2, Tactic: 3071479995783211391, stage3_unit5_relu1[Half(1,1024,14,14)] -> stage3_unit5_relu2[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit5_conv2 + stage3_unit5_relu3, Tactic: -6902925267326201166, stage3_unit5_relu2[Half(1,256,14,14)] -> stage3_unit5_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit5_conv3 + _plus11, Tactic: -5409588854490562130, stage3_unit5_relu3[Half(1,256,14,14)], _plus10[Half(1,1024,14,14)] -> _plus11[Half(1,1024,14,14)] Layer(Scale): stage3_unit6_bn1 + stage3_unit6_relu1, Tactic: 0, _plus11[Half(1,1024,14,14)] -> stage3_unit6_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage3_unit6_conv1 + stage3_unit6_relu2, Tactic: 3071479995783211391, stage3_unit6_relu1[Half(1,1024,14,14)] -> stage3_unit6_relu2[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit6_conv2 + stage3_unit6_relu3, Tactic: -6902925267326201166, stage3_unit6_relu2[Half(1,256,14,14)] -> stage3_unit6_relu3[Half(1,256,14,14)] Layer(CaskConvolution): stage3_unit6_conv3 + _plus12, Tactic: -5409588854490562130, stage3_unit6_relu3[Half(1,256,14,14)], _plus11[Half(1,1024,14,14)] -> _plus12[Half(1,1024,14,14)] Layer(Scale): stage4_unit1_bn1 + stage4_unit1_relu1, Tactic: 0, _plus12[Half(1,1024,14,14)] -> stage4_unit1_relu1[Half(1,1024,14,14)] Layer(CaskConvolution): stage4_unit1_conv1 + stage4_unit1_relu2, Tactic: 3899310434460415852, stage4_unit1_relu1[Half(1,1024,14,14)] -> stage4_unit1_relu2[Half(1,512,14,14)] Layer(CaskConvolution): stage4_unit1_conv2 + stage4_unit1_relu3, Tactic: -6902925267326201166, stage4_unit1_relu2[Half(1,512,14,14)] -> stage4_unit1_relu3[Half(1,512,7,7)] Layer(CaskConvolution): stage4_unit1_conv3, Tactic: 3899310434460415852, stage4_unit1_relu3[Half(1,512,7,7)] -> stage4_unit1_conv3[Half(1,2048,7,7)] Layer(CaskConvolution): stage4_unit1_sc + _plus13, Tactic: -4293222705763522367, stage4_unit1_relu1[Half(1,1024,14,14)], stage4_unit1_conv3[Half(1,2048,7,7)] -> _plus13[Half(1,2048,7,7)] Layer(Scale): stage4_unit2_bn1 + stage4_unit2_relu1, Tactic: 0, _plus13[Half(1,2048,7,7)] -> stage4_unit2_relu1[Half(1,2048,7,7)] Layer(CaskConvolution): stage4_unit2_conv1 + stage4_unit2_relu2, Tactic: -1828674067637788567, stage4_unit2_relu1[Half(1,2048,7,7)] -> stage4_unit2_relu2[Half(1,512,7,7)] Layer(CaskConvolution): stage4_unit2_conv2 + stage4_unit2_relu3, Tactic: 6350273239113254096, stage4_unit2_relu2[Half(1,512,7,7)] -> stage4_unit2_relu3[Half(1,512,7,7)] Layer(CaskConvolution): stage4_unit2_conv3 + _plus14, Tactic: 3071479995783211391, stage4_unit2_relu3[Half(1,512,7,7)], _plus13[Half(1,2048,7,7)] -> _plus14[Half(1,2048,7,7)] Layer(Scale): stage4_unit3_bn1 + stage4_unit3_relu1, Tactic: 0, _plus14[Half(1,2048,7,7)] -> stage4_unit3_relu1[Half(1,2048,7,7)] Layer(CaskConvolution): stage4_unit3_conv1 + stage4_unit3_relu2, Tactic: -1828674067637788567, stage4_unit3_relu1[Half(1,2048,7,7)] -> stage4_unit3_relu2[Half(1,512,7,7)] Layer(CaskConvolution): stage4_unit3_conv2 + stage4_unit3_relu3, Tactic: 6350273239113254096, stage4_unit3_relu2[Half(1,512,7,7)] -> stage4_unit3_relu3[Half(1,512,7,7)] Layer(CaskConvolution): stage4_unit3_conv3 + _plus15, Tactic: 3071479995783211391, stage4_unit3_relu3[Half(1,512,7,7)], _plus14[Half(1,2048,7,7)] -> _plus15[Half(1,2048,7,7)] Layer(Scale): bn1 + relu1, Tactic: 0, _plus15[Half(1,2048,7,7)] -> relu1[Half(1,2048,7,7)] Layer(CudnnPooling): pool1, Tactic: -1, relu1[Half(1,2048,7,7)] -> pool1[Half(1,2048,1,1)] Layer(CaskConvolution): fc1, Tactic: 3071479995783211391, pool1[Half(1,2048,1,1)] -> (Unnamed Layer* 175) [Fully Connected]_output[Half(1,1000,1,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to (Unnamed Layer* 176) [Shuffle], Tactic: 0, (Unnamed Layer* 175) [Fully Connected]_output[Half(1,1000,1,1)] -> Reformatted Input Tensor 0 to (Unnamed Layer* 176) [Shuffle][Float(1,1000,1,1)] Layer(CudaSoftMax): softmax, Tactic: 1001, cast1[Float(1,1000)] -> softmax[Float(1,1000)] [05/21/2021-05:50:37] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 2384 MiB, GPU 11568 MiB [05/21/2021-05:50:37] [I] Engine built in 224.45 sec. [05/21/2021-05:50:37] [V] [TRT] Using cublasLt a tactic source [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 2285, GPU 11578 (MiB) [05/21/2021-05:50:37] [V] [TRT] Using cuDNN as a tactic source [05/21/2021-05:50:37] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 2285, GPU 11586 (MiB) [05/21/2021-05:50:37] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4 [05/21/2021-05:50:37] [V] [TRT] Total per-runner device memory is 51277824 [05/21/2021-05:50:37] [V] [TRT] Total per-runner host memory is 202544 [05/21/2021-05:50:37] [V] [TRT] Allocated activation device memory of size 5017600 [05/21/2021-05:50:37] [I] Created input binding for data with dimensions 1x3x224x224 [05/21/2021-05:50:37] [I] Created output binding for softmax with dimensions 1x1000 [05/21/2021-05:50:37] [I] Starting inference [05/21/2021-05:50:40] [I] Warmup completed 328 queries over 200 ms [05/21/2021-05:50:40] [I] Timing trace has 4853 queries over 3.00158 s [05/21/2021-05:50:40] [I] [05/21/2021-05:50:40] [I] === Trace details === [05/21/2021-05:50:40] [I] Trace averages of 10 runs: [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591255 ms - Host latency: 0.645226 ms (end to end 1.17748 ms, enqueue 0.274773 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61174 ms - Host latency: 0.666116 ms (end to end 1.18273 ms, enqueue 0.280095 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586958 ms - Host latency: 0.641017 ms (end to end 1.14416 ms, enqueue 0.276741 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.639278 ms - Host latency: 0.693597 ms (end to end 1.2481 ms, enqueue 0.278197 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629655 ms - Host latency: 0.683223 ms (end to end 1.20695 ms, enqueue 0.2748 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594429 ms - Host latency: 0.648512 ms (end to end 1.18539 ms, enqueue 0.279672 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612248 ms - Host latency: 0.665813 ms (end to end 1.19895 ms, enqueue 0.275206 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.6146 ms - Host latency: 0.668556 ms (end to end 1.1743 ms, enqueue 0.279109 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590439 ms - Host latency: 0.644785 ms (end to end 1.17336 ms, enqueue 0.278043 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615733 ms - Host latency: 0.669606 ms (end to end 1.20329 ms, enqueue 0.275055 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591364 ms - Host latency: 0.645148 ms (end to end 1.15875 ms, enqueue 0.275436 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616959 ms - Host latency: 0.670529 ms (end to end 1.20535 ms, enqueue 0.276648 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614911 ms - Host latency: 0.668732 ms (end to end 1.18705 ms, enqueue 0.274167 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.603238 ms - Host latency: 0.657437 ms (end to end 1.19568 ms, enqueue 0.27843 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623929 ms - Host latency: 0.677942 ms (end to end 1.22142 ms, enqueue 0.278354 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595767 ms - Host latency: 0.650403 ms (end to end 1.15649 ms, enqueue 0.279181 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618088 ms - Host latency: 0.67149 ms (end to end 1.21077 ms, enqueue 0.273605 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612753 ms - Host latency: 0.666583 ms (end to end 1.17664 ms, enqueue 0.277014 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589319 ms - Host latency: 0.643002 ms (end to end 1.17319 ms, enqueue 0.275043 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612561 ms - Host latency: 0.666309 ms (end to end 1.20017 ms, enqueue 0.27413 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618604 ms - Host latency: 0.672766 ms (end to end 1.18083 ms, enqueue 0.278879 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590442 ms - Host latency: 0.644247 ms (end to end 1.17368 ms, enqueue 0.27786 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61174 ms - Host latency: 0.665652 ms (end to end 1.20025 ms, enqueue 0.27543 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595862 ms - Host latency: 0.64985 ms (end to end 1.16731 ms, enqueue 0.274774 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629556 ms - Host latency: 0.684293 ms (end to end 1.22575 ms, enqueue 0.279117 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.625662 ms - Host latency: 0.679605 ms (end to end 1.20113 ms, enqueue 0.275552 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59136 ms - Host latency: 0.64606 ms (end to end 1.17275 ms, enqueue 0.280054 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614816 ms - Host latency: 0.668893 ms (end to end 1.20146 ms, enqueue 0.276175 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618802 ms - Host latency: 0.672589 ms (end to end 1.18959 ms, enqueue 0.274658 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591357 ms - Host latency: 0.645319 ms (end to end 1.17885 ms, enqueue 0.274805 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610815 ms - Host latency: 0.664969 ms (end to end 1.18852 ms, enqueue 0.279282 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586951 ms - Host latency: 0.640585 ms (end to end 1.14948 ms, enqueue 0.275629 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612042 ms - Host latency: 0.666641 ms (end to end 1.19058 ms, enqueue 0.280084 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61235 ms - Host latency: 0.666504 ms (end to end 1.17195 ms, enqueue 0.277087 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613889 ms - Host latency: 0.667947 ms (end to end 1.22434 ms, enqueue 0.276816 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.633548 ms - Host latency: 0.687213 ms (end to end 1.24629 ms, enqueue 0.272052 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.620026 ms - Host latency: 0.673654 ms (end to end 1.19808 ms, enqueue 0.271323 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59321 ms - Host latency: 0.646945 ms (end to end 1.18253 ms, enqueue 0.277142 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617987 ms - Host latency: 0.671674 ms (end to end 1.2107 ms, enqueue 0.274838 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589819 ms - Host latency: 0.643854 ms (end to end 1.14941 ms, enqueue 0.278088 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611322 ms - Host latency: 0.664996 ms (end to end 1.1951 ms, enqueue 0.276102 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611328 ms - Host latency: 0.665302 ms (end to end 1.16755 ms, enqueue 0.279614 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595657 ms - Host latency: 0.650012 ms (end to end 1.18259 ms, enqueue 0.278037 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611536 ms - Host latency: 0.665564 ms (end to end 1.19764 ms, enqueue 0.274326 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.596271 ms - Host latency: 0.650232 ms (end to end 1.16712 ms, enqueue 0.274298 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62157 ms - Host latency: 0.675436 ms (end to end 1.22095 ms, enqueue 0.273584 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621256 ms - Host latency: 0.67532 ms (end to end 1.18994 ms, enqueue 0.276129 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594128 ms - Host latency: 0.647818 ms (end to end 1.18881 ms, enqueue 0.275015 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.608359 ms - Host latency: 0.662216 ms (end to end 1.19105 ms, enqueue 0.274927 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616858 ms - Host latency: 0.670581 ms (end to end 1.18545 ms, enqueue 0.276843 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594742 ms - Host latency: 0.648172 ms (end to end 1.19201 ms, enqueue 0.271371 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614914 ms - Host latency: 0.668927 ms (end to end 1.19792 ms, enqueue 0.277548 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590454 ms - Host latency: 0.64408 ms (end to end 1.15944 ms, enqueue 0.274774 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614105 ms - Host latency: 0.667841 ms (end to end 1.20594 ms, enqueue 0.272174 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.6229 ms - Host latency: 0.677094 ms (end to end 1.18899 ms, enqueue 0.277295 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599335 ms - Host latency: 0.653333 ms (end to end 1.19914 ms, enqueue 0.278552 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624847 ms - Host latency: 0.67843 ms (end to end 1.22917 ms, enqueue 0.272614 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616571 ms - Host latency: 0.670007 ms (end to end 1.18896 ms, enqueue 0.272729 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590442 ms - Host latency: 0.644318 ms (end to end 1.17416 ms, enqueue 0.277472 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616449 ms - Host latency: 0.670319 ms (end to end 1.18451 ms, enqueue 0.276086 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59422 ms - Host latency: 0.648096 ms (end to end 1.18148 ms, enqueue 0.275812 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615936 ms - Host latency: 0.669507 ms (end to end 1.20748 ms, enqueue 0.27431 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617566 ms - Host latency: 0.671613 ms (end to end 1.17877 ms, enqueue 0.279163 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591754 ms - Host latency: 0.645703 ms (end to end 1.18152 ms, enqueue 0.278229 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623828 ms - Host latency: 0.680109 ms (end to end 1.21686 ms, enqueue 0.27912 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.596173 ms - Host latency: 0.650482 ms (end to end 1.16448 ms, enqueue 0.275885 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627704 ms - Host latency: 0.681952 ms (end to end 1.22228 ms, enqueue 0.279999 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628723 ms - Host latency: 0.682507 ms (end to end 1.20941 ms, enqueue 0.27381 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593512 ms - Host latency: 0.647144 ms (end to end 1.18748 ms, enqueue 0.275079 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614606 ms - Host latency: 0.668402 ms (end to end 1.1985 ms, enqueue 0.276031 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617249 ms - Host latency: 0.670856 ms (end to end 1.1838 ms, enqueue 0.27453 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590942 ms - Host latency: 0.644952 ms (end to end 1.17722 ms, enqueue 0.276508 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613275 ms - Host latency: 0.667041 ms (end to end 1.19664 ms, enqueue 0.276398 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.58808 ms - Host latency: 0.641827 ms (end to end 1.15562 ms, enqueue 0.272504 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610199 ms - Host latency: 0.664191 ms (end to end 1.19039 ms, enqueue 0.277448 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621161 ms - Host latency: 0.674921 ms (end to end 1.19376 ms, enqueue 0.275983 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.60047 ms - Host latency: 0.654712 ms (end to end 1.19904 ms, enqueue 0.277051 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.630792 ms - Host latency: 0.685114 ms (end to end 1.2295 ms, enqueue 0.277863 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61275 ms - Host latency: 0.666687 ms (end to end 1.17571 ms, enqueue 0.276459 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590942 ms - Host latency: 0.644653 ms (end to end 1.17983 ms, enqueue 0.272485 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.6151 ms - Host latency: 0.669141 ms (end to end 1.20019 ms, enqueue 0.276794 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593701 ms - Host latency: 0.647607 ms (end to end 1.15498 ms, enqueue 0.277905 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613684 ms - Host latency: 0.667078 ms (end to end 1.2064 ms, enqueue 0.271692 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611737 ms - Host latency: 0.666028 ms (end to end 1.173 ms, enqueue 0.277093 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590234 ms - Host latency: 0.644318 ms (end to end 1.18001 ms, enqueue 0.272406 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.625983 ms - Host latency: 0.680884 ms (end to end 1.21575 ms, enqueue 0.282196 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629767 ms - Host latency: 0.683508 ms (end to end 1.21388 ms, enqueue 0.273907 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59884 ms - Host latency: 0.653351 ms (end to end 1.18585 ms, enqueue 0.281964 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619006 ms - Host latency: 0.672778 ms (end to end 1.19028 ms, enqueue 0.275031 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590649 ms - Host latency: 0.644556 ms (end to end 1.17869 ms, enqueue 0.274237 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619611 ms - Host latency: 0.673389 ms (end to end 1.21457 ms, enqueue 0.275073 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615118 ms - Host latency: 0.669415 ms (end to end 1.16918 ms, enqueue 0.281134 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591162 ms - Host latency: 0.645178 ms (end to end 1.18043 ms, enqueue 0.2745 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.642566 ms - Host latency: 0.696399 ms (end to end 1.22263 ms, enqueue 0.357538 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594427 ms - Host latency: 0.648218 ms (end to end 1.16511 ms, enqueue 0.275354 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623627 ms - Host latency: 0.677673 ms (end to end 1.22021 ms, enqueue 0.277179 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628217 ms - Host latency: 0.682318 ms (end to end 1.20056 ms, enqueue 0.277527 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599774 ms - Host latency: 0.653528 ms (end to end 1.20309 ms, enqueue 0.275305 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615723 ms - Host latency: 0.670209 ms (end to end 1.19354 ms, enqueue 0.282196 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612543 ms - Host latency: 0.666058 ms (end to end 1.17685 ms, enqueue 0.274225 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.587067 ms - Host latency: 0.641577 ms (end to end 1.16259 ms, enqueue 0.280109 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.609277 ms - Host latency: 0.663068 ms (end to end 1.17324 ms, enqueue 0.275024 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590637 ms - Host latency: 0.64519 ms (end to end 1.17674 ms, enqueue 0.277997 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.606824 ms - Host latency: 0.661658 ms (end to end 1.16693 ms, enqueue 0.278162 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610608 ms - Host latency: 0.665717 ms (end to end 1.15284 ms, enqueue 0.277527 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594135 ms - Host latency: 0.6492 ms (end to end 1.16599 ms, enqueue 0.27926 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599957 ms - Host latency: 0.655035 ms (end to end 1.20485 ms, enqueue 0.278497 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595166 ms - Host latency: 0.650183 ms (end to end 1.14474 ms, enqueue 0.27796 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623633 ms - Host latency: 0.678345 ms (end to end 1.2053 ms, enqueue 0.275159 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610095 ms - Host latency: 0.665045 ms (end to end 1.15332 ms, enqueue 0.278113 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586346 ms - Host latency: 0.641022 ms (end to end 1.14869 ms, enqueue 0.278223 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614294 ms - Host latency: 0.668958 ms (end to end 1.18366 ms, enqueue 0.278363 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590338 ms - Host latency: 0.645007 ms (end to end 1.13882 ms, enqueue 0.275726 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613904 ms - Host latency: 0.668726 ms (end to end 1.17913 ms, enqueue 0.279364 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610822 ms - Host latency: 0.665765 ms (end to end 1.16273 ms, enqueue 0.274731 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589929 ms - Host latency: 0.64491 ms (end to end 1.15358 ms, enqueue 0.27962 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.620471 ms - Host latency: 0.675201 ms (end to end 1.20049 ms, enqueue 0.273621 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.630975 ms - Host latency: 0.685529 ms (end to end 1.18962 ms, enqueue 0.276025 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598242 ms - Host latency: 0.653192 ms (end to end 1.18008 ms, enqueue 0.277863 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.606818 ms - Host latency: 0.661761 ms (end to end 1.14411 ms, enqueue 0.279456 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593298 ms - Host latency: 0.648071 ms (end to end 1.16012 ms, enqueue 0.277625 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.6229 ms - Host latency: 0.680298 ms (end to end 1.1992 ms, enqueue 0.277655 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613678 ms - Host latency: 0.668414 ms (end to end 1.16055 ms, enqueue 0.275977 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590442 ms - Host latency: 0.64469 ms (end to end 1.17097 ms, enqueue 0.27146 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611743 ms - Host latency: 0.666064 ms (end to end 1.19268 ms, enqueue 0.269629 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588696 ms - Host latency: 0.643964 ms (end to end 1.12971 ms, enqueue 0.277661 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627228 ms - Host latency: 0.68205 ms (end to end 1.20861 ms, enqueue 0.278717 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624432 ms - Host latency: 0.679761 ms (end to end 1.17673 ms, enqueue 0.278326 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598108 ms - Host latency: 0.653418 ms (end to end 1.17076 ms, enqueue 0.280103 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618811 ms - Host latency: 0.67359 ms (end to end 1.19438 ms, enqueue 0.275763 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611212 ms - Host latency: 0.665845 ms (end to end 1.15212 ms, enqueue 0.27804 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589417 ms - Host latency: 0.644019 ms (end to end 1.15691 ms, enqueue 0.2784 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614185 ms - Host latency: 0.668573 ms (end to end 1.1876 ms, enqueue 0.275745 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590033 ms - Host latency: 0.64491 ms (end to end 1.1333 ms, enqueue 0.278204 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590662 ms - Host latency: 0.645081 ms (end to end 1.17946 ms, enqueue 0.275201 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.607776 ms - Host latency: 0.662683 ms (end to end 1.15054 ms, enqueue 0.278479 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590662 ms - Host latency: 0.645581 ms (end to end 1.15616 ms, enqueue 0.277161 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.631909 ms - Host latency: 0.687158 ms (end to end 1.2116 ms, enqueue 0.279687 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598938 ms - Host latency: 0.65376 ms (end to end 1.15299 ms, enqueue 0.275916 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619409 ms - Host latency: 0.673853 ms (end to end 1.19351 ms, enqueue 0.27804 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614917 ms - Host latency: 0.670056 ms (end to end 1.15498 ms, enqueue 0.280298 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591455 ms - Host latency: 0.646094 ms (end to end 1.16071 ms, enqueue 0.277832 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618176 ms - Host latency: 0.67301 ms (end to end 1.1922 ms, enqueue 0.276477 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613269 ms - Host latency: 0.667554 ms (end to end 1.16028 ms, enqueue 0.275635 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589539 ms - Host latency: 0.644641 ms (end to end 1.15259 ms, enqueue 0.280115 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619397 ms - Host latency: 0.674426 ms (end to end 1.19292 ms, enqueue 0.277759 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589294 ms - Host latency: 0.644409 ms (end to end 1.13263 ms, enqueue 0.278259 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624646 ms - Host latency: 0.679736 ms (end to end 1.20098 ms, enqueue 0.278638 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627808 ms - Host latency: 0.682751 ms (end to end 1.18517 ms, enqueue 0.276624 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594409 ms - Host latency: 0.649133 ms (end to end 1.17561 ms, enqueue 0.276233 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614087 ms - Host latency: 0.668445 ms (end to end 1.18772 ms, enqueue 0.274255 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586987 ms - Host latency: 0.641516 ms (end to end 1.13075 ms, enqueue 0.275671 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.609766 ms - Host latency: 0.664416 ms (end to end 1.17535 ms, enqueue 0.278516 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611121 ms - Host latency: 0.665601 ms (end to end 1.15389 ms, enqueue 0.276111 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.5901 ms - Host latency: 0.645166 ms (end to end 1.15757 ms, enqueue 0.277637 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611206 ms - Host latency: 0.66615 ms (end to end 1.17578 ms, enqueue 0.277417 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612756 ms - Host latency: 0.667078 ms (end to end 1.16473 ms, enqueue 0.274463 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.566687 ms - Host latency: 0.62157 ms (end to end 1.11027 ms, enqueue 0.278174 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.552942 ms - Host latency: 0.621545 ms (end to end 1.06401 ms, enqueue 0.2776 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.551709 ms - Host latency: 0.611438 ms (end to end 1.05405 ms, enqueue 0.28219 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612354 ms - Host latency: 0.667017 ms (end to end 1.17732 ms, enqueue 0.284485 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.553589 ms - Host latency: 0.618896 ms (end to end 1.06177 ms, enqueue 0.28523 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.54856 ms - Host latency: 0.605749 ms (end to end 1.05891 ms, enqueue 0.272192 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.602124 ms - Host latency: 0.66416 ms (end to end 1.16484 ms, enqueue 0.273413 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.552551 ms - Host latency: 0.614136 ms (end to end 1.07473 ms, enqueue 0.28197 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.545483 ms - Host latency: 0.600024 ms (end to end 1.04991 ms, enqueue 0.274182 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610181 ms - Host latency: 0.669177 ms (end to end 1.16797 ms, enqueue 0.289551 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.55354 ms - Host latency: 0.617932 ms (end to end 1.04958 ms, enqueue 0.27959 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.544458 ms - Host latency: 0.599451 ms (end to end 1.03671 ms, enqueue 0.286926 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.813257 ms - Host latency: 0.878516 ms (end to end 1.55658 ms, enqueue 0.294849 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.02095 ms - Host latency: 1.07574 ms (end to end 1.99822 ms, enqueue 0.276379 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.25717 ms - Host latency: 1.3123 ms (end to end 2.46454 ms, enqueue 0.279382 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.25889 ms - Host latency: 1.31361 ms (end to end 2.22938 ms, enqueue 0.278589 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.01971 ms - Host latency: 1.07462 ms (end to end 2.23541 ms, enqueue 0.276855 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.254 ms - Host latency: 1.309 ms (end to end 2.46324 ms, enqueue 0.278137 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.25737 ms - Host latency: 1.31293 ms (end to end 2.22717 ms, enqueue 0.279907 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.02072 ms - Host latency: 1.07552 ms (end to end 2.2374 ms, enqueue 0.278662 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 1.1423 ms - Host latency: 1.19735 ms (end to end 2.23992 ms, enqueue 0.277539 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.601916 ms - Host latency: 0.656726 ms (end to end 1.16171 ms, enqueue 0.276965 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.625049 ms - Host latency: 0.679846 ms (end to end 1.20789 ms, enqueue 0.275793 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.631177 ms - Host latency: 0.686243 ms (end to end 1.18743 ms, enqueue 0.277014 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590747 ms - Host latency: 0.645813 ms (end to end 1.16417 ms, enqueue 0.280103 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612036 ms - Host latency: 0.666736 ms (end to end 1.18077 ms, enqueue 0.276221 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615442 ms - Host latency: 0.669751 ms (end to end 1.16775 ms, enqueue 0.27489 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590149 ms - Host latency: 0.644934 ms (end to end 1.15742 ms, enqueue 0.277161 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617456 ms - Host latency: 0.671985 ms (end to end 1.19579 ms, enqueue 0.272913 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589014 ms - Host latency: 0.643945 ms (end to end 1.13181 ms, enqueue 0.277454 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615625 ms - Host latency: 0.670764 ms (end to end 1.17981 ms, enqueue 0.277832 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.622168 ms - Host latency: 0.67699 ms (end to end 1.17396 ms, enqueue 0.275476 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599634 ms - Host latency: 0.654651 ms (end to end 1.18499 ms, enqueue 0.27782 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.625952 ms - Host latency: 0.680774 ms (end to end 1.20775 ms, enqueue 0.276257 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590161 ms - Host latency: 0.6448 ms (end to end 1.13966 ms, enqueue 0.272974 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610742 ms - Host latency: 0.665454 ms (end to end 1.17565 ms, enqueue 0.277881 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615515 ms - Host latency: 0.670593 ms (end to end 1.15995 ms, enqueue 0.279639 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591553 ms - Host latency: 0.646265 ms (end to end 1.15811 ms, enqueue 0.278455 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610522 ms - Host latency: 0.665173 ms (end to end 1.17787 ms, enqueue 0.277258 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611108 ms - Host latency: 0.665613 ms (end to end 1.15924 ms, enqueue 0.275781 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59054 ms - Host latency: 0.645471 ms (end to end 1.1574 ms, enqueue 0.278564 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62771 ms - Host latency: 0.68291 ms (end to end 1.20815 ms, enqueue 0.277722 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.602209 ms - Host latency: 0.657129 ms (end to end 1.15867 ms, enqueue 0.27749 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.638342 ms - Host latency: 0.693799 ms (end to end 1.22697 ms, enqueue 0.279675 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.622803 ms - Host latency: 0.678113 ms (end to end 1.17048 ms, enqueue 0.280054 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590063 ms - Host latency: 0.644568 ms (end to end 1.16178 ms, enqueue 0.275757 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614929 ms - Host latency: 0.669434 ms (end to end 1.18945 ms, enqueue 0.276746 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617041 ms - Host latency: 0.67168 ms (end to end 1.16371 ms, enqueue 0.278528 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588904 ms - Host latency: 0.64342 ms (end to end 1.16312 ms, enqueue 0.276526 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.607642 ms - Host latency: 0.662512 ms (end to end 1.14434 ms, enqueue 0.280408 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589722 ms - Host latency: 0.644324 ms (end to end 1.15658 ms, enqueue 0.276392 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616772 ms - Host latency: 0.672119 ms (end to end 1.18599 ms, enqueue 0.278564 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62605 ms - Host latency: 0.68103 ms (end to end 1.17588 ms, enqueue 0.280029 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599646 ms - Host latency: 0.654333 ms (end to end 1.18387 ms, enqueue 0.27738 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.631995 ms - Host latency: 0.686621 ms (end to end 1.22185 ms, enqueue 0.27644 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585938 ms - Host latency: 0.640491 ms (end to end 1.1265 ms, enqueue 0.279395 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618799 ms - Host latency: 0.673694 ms (end to end 1.18744 ms, enqueue 0.27937 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61449 ms - Host latency: 0.669385 ms (end to end 1.15747 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590454 ms - Host latency: 0.644873 ms (end to end 1.16257 ms, enqueue 0.276465 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61499 ms - Host latency: 0.669971 ms (end to end 1.18261 ms, enqueue 0.278418 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614697 ms - Host latency: 0.668079 ms (end to end 1.18475 ms, enqueue 0.262109 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589551 ms - Host latency: 0.644727 ms (end to end 1.15699 ms, enqueue 0.278821 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.620618 ms - Host latency: 0.675549 ms (end to end 1.1986 ms, enqueue 0.275745 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.601697 ms - Host latency: 0.656531 ms (end to end 1.15828 ms, enqueue 0.278381 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.632544 ms - Host latency: 0.687512 ms (end to end 1.2217 ms, enqueue 0.276904 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617554 ms - Host latency: 0.672034 ms (end to end 1.16925 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59043 ms - Host latency: 0.64502 ms (end to end 1.15504 ms, enqueue 0.278137 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613684 ms - Host latency: 0.668628 ms (end to end 1.18142 ms, enqueue 0.279041 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.587073 ms - Host latency: 0.641711 ms (end to end 1.12802 ms, enqueue 0.277856 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611841 ms - Host latency: 0.666284 ms (end to end 1.18082 ms, enqueue 0.276306 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611621 ms - Host latency: 0.666357 ms (end to end 1.15111 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589514 ms - Host latency: 0.644226 ms (end to end 1.16165 ms, enqueue 0.276038 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618799 ms - Host latency: 0.673792 ms (end to end 1.1938 ms, enqueue 0.277087 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629675 ms - Host latency: 0.684705 ms (end to end 1.18739 ms, enqueue 0.276404 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59884 ms - Host latency: 0.653589 ms (end to end 1.18411 ms, enqueue 0.276941 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619922 ms - Host latency: 0.674866 ms (end to end 1.19044 ms, enqueue 0.279651 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.58595 ms - Host latency: 0.640808 ms (end to end 1.12506 ms, enqueue 0.279028 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624731 ms - Host latency: 0.679578 ms (end to end 1.19982 ms, enqueue 0.278186 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613367 ms - Host latency: 0.668213 ms (end to end 1.15564 ms, enqueue 0.278406 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.58623 ms - Host latency: 0.640613 ms (end to end 1.15718 ms, enqueue 0.274023 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610706 ms - Host latency: 0.665417 ms (end to end 1.17427 ms, enqueue 0.278882 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594543 ms - Host latency: 0.649524 ms (end to end 1.14545 ms, enqueue 0.276343 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615625 ms - Host latency: 0.670593 ms (end to end 1.18624 ms, enqueue 0.278259 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629346 ms - Host latency: 0.683899 ms (end to end 1.19041 ms, enqueue 0.277747 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59762 ms - Host latency: 0.65238 ms (end to end 1.17487 ms, enqueue 0.278638 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629138 ms - Host latency: 0.68363 ms (end to end 1.21851 ms, enqueue 0.276501 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613684 ms - Host latency: 0.668005 ms (end to end 1.16113 ms, enqueue 0.276611 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59646 ms - Host latency: 0.651306 ms (end to end 1.1699 ms, enqueue 0.278931 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610608 ms - Host latency: 0.665247 ms (end to end 1.17393 ms, enqueue 0.277502 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590027 ms - Host latency: 0.644458 ms (end to end 1.13912 ms, enqueue 0.2771 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615112 ms - Host latency: 0.669873 ms (end to end 1.18381 ms, enqueue 0.277759 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611438 ms - Host latency: 0.666016 ms (end to end 1.15575 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591187 ms - Host latency: 0.646375 ms (end to end 1.15651 ms, enqueue 0.278333 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.630981 ms - Host latency: 0.68595 ms (end to end 1.2166 ms, enqueue 0.27948 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623425 ms - Host latency: 0.678601 ms (end to end 1.1717 ms, enqueue 0.277588 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.603137 ms - Host latency: 0.658411 ms (end to end 1.185 ms, enqueue 0.279895 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621863 ms - Host latency: 0.676868 ms (end to end 1.19873 ms, enqueue 0.278113 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590015 ms - Host latency: 0.644739 ms (end to end 1.14087 ms, enqueue 0.274719 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624377 ms - Host latency: 0.680383 ms (end to end 1.19735 ms, enqueue 0.2802 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61543 ms - Host latency: 0.670276 ms (end to end 1.15935 ms, enqueue 0.278589 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590247 ms - Host latency: 0.645032 ms (end to end 1.16067 ms, enqueue 0.276611 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618066 ms - Host latency: 0.672534 ms (end to end 1.19352 ms, enqueue 0.276624 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.608276 ms - Host latency: 0.662659 ms (end to end 1.15531 ms, enqueue 0.274304 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593799 ms - Host latency: 0.649109 ms (end to end 1.16152 ms, enqueue 0.278979 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624536 ms - Host latency: 0.67926 ms (end to end 1.1796 ms, enqueue 0.276282 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.597815 ms - Host latency: 0.652893 ms (end to end 1.16853 ms, enqueue 0.279419 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619824 ms - Host latency: 0.674719 ms (end to end 1.19374 ms, enqueue 0.278992 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613672 ms - Host latency: 0.668298 ms (end to end 1.15952 ms, enqueue 0.275757 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590332 ms - Host latency: 0.645007 ms (end to end 1.16113 ms, enqueue 0.277527 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610303 ms - Host latency: 0.664697 ms (end to end 1.1781 ms, enqueue 0.276709 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589197 ms - Host latency: 0.644312 ms (end to end 1.13336 ms, enqueue 0.278162 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614697 ms - Host latency: 0.669189 ms (end to end 1.19053 ms, enqueue 0.274158 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614392 ms - Host latency: 0.6698 ms (end to end 1.1584 ms, enqueue 0.281372 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589709 ms - Host latency: 0.644055 ms (end to end 1.16053 ms, enqueue 0.276672 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623792 ms - Host latency: 0.678784 ms (end to end 1.20624 ms, enqueue 0.276917 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595996 ms - Host latency: 0.650891 ms (end to end 1.15059 ms, enqueue 0.276331 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624011 ms - Host latency: 0.678943 ms (end to end 1.19965 ms, enqueue 0.28125 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.607263 ms - Host latency: 0.66178 ms (end to end 1.15026 ms, enqueue 0.276904 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589941 ms - Host latency: 0.644568 ms (end to end 1.1531 ms, enqueue 0.278503 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610913 ms - Host latency: 0.665649 ms (end to end 1.17538 ms, enqueue 0.279126 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624841 ms - Host latency: 0.679358 ms (end to end 1.17974 ms, enqueue 0.277051 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.592969 ms - Host latency: 0.648096 ms (end to end 1.16155 ms, enqueue 0.280237 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614294 ms - Host latency: 0.669238 ms (end to end 1.18262 ms, enqueue 0.277625 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586328 ms - Host latency: 0.64115 ms (end to end 1.13206 ms, enqueue 0.277112 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615735 ms - Host latency: 0.670459 ms (end to end 1.18934 ms, enqueue 0.275574 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.626086 ms - Host latency: 0.680945 ms (end to end 1.17848 ms, enqueue 0.277856 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598877 ms - Host latency: 0.653723 ms (end to end 1.18206 ms, enqueue 0.278345 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615112 ms - Host latency: 0.669592 ms (end to end 1.18738 ms, enqueue 0.276501 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588806 ms - Host latency: 0.643787 ms (end to end 1.12832 ms, enqueue 0.279675 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623596 ms - Host latency: 0.682288 ms (end to end 1.19813 ms, enqueue 0.280359 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614392 ms - Host latency: 0.669031 ms (end to end 1.16482 ms, enqueue 0.276453 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590234 ms - Host latency: 0.645117 ms (end to end 1.15422 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610803 ms - Host latency: 0.66554 ms (end to end 1.17925 ms, enqueue 0.276587 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61145 ms - Host latency: 0.666394 ms (end to end 1.1526 ms, enqueue 0.279236 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594312 ms - Host latency: 0.649133 ms (end to end 1.16978 ms, enqueue 0.277039 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621362 ms - Host latency: 0.676379 ms (end to end 1.19357 ms, enqueue 0.280286 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.60199 ms - Host latency: 0.656653 ms (end to end 1.16322 ms, enqueue 0.276245 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623499 ms - Host latency: 0.678076 ms (end to end 1.20455 ms, enqueue 0.276733 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610278 ms - Host latency: 0.664673 ms (end to end 1.15752 ms, enqueue 0.276672 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590332 ms - Host latency: 0.644873 ms (end to end 1.15917 ms, enqueue 0.275037 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614233 ms - Host latency: 0.668872 ms (end to end 1.18306 ms, enqueue 0.278613 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593091 ms - Host latency: 0.647803 ms (end to end 1.14583 ms, enqueue 0.275122 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610205 ms - Host latency: 0.664795 ms (end to end 1.1709 ms, enqueue 0.280127 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610718 ms - Host latency: 0.665454 ms (end to end 1.1562 ms, enqueue 0.278345 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586011 ms - Host latency: 0.640454 ms (end to end 1.15125 ms, enqueue 0.276367 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628247 ms - Host latency: 0.683057 ms (end to end 1.21548 ms, enqueue 0.276123 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.629761 ms - Host latency: 0.686328 ms (end to end 1.18667 ms, enqueue 0.27727 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594482 ms - Host latency: 0.64978 ms (end to end 1.16953 ms, enqueue 0.279199 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617822 ms - Host latency: 0.672705 ms (end to end 1.19041 ms, enqueue 0.27915 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593603 ms - Host latency: 0.649072 ms (end to end 1.13984 ms, enqueue 0.279224 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61123 ms - Host latency: 0.668115 ms (end to end 1.16917 ms, enqueue 0.280151 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613452 ms - Host latency: 0.669556 ms (end to end 1.14626 ms, enqueue 0.283228 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589502 ms - Host latency: 0.644312 ms (end to end 1.15906 ms, enqueue 0.277393 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613599 ms - Host latency: 0.668213 ms (end to end 1.1875 ms, enqueue 0.276685 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589478 ms - Host latency: 0.64436 ms (end to end 1.13579 ms, enqueue 0.278052 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619653 ms - Host latency: 0.674512 ms (end to end 1.19583 ms, enqueue 0.276831 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.633789 ms - Host latency: 0.689087 ms (end to end 1.18843 ms, enqueue 0.280688 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598145 ms - Host latency: 0.65293 ms (end to end 1.18191 ms, enqueue 0.278198 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61145 ms - Host latency: 0.665869 ms (end to end 1.18123 ms, enqueue 0.276709 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610254 ms - Host latency: 0.665088 ms (end to end 1.15356 ms, enqueue 0.277368 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585547 ms - Host latency: 0.640308 ms (end to end 1.14622 ms, enqueue 0.278955 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62251 ms - Host latency: 0.677148 ms (end to end 1.2021 ms, enqueue 0.277246 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586548 ms - Host latency: 0.641455 ms (end to end 1.13181 ms, enqueue 0.277002 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611011 ms - Host latency: 0.66604 ms (end to end 1.17539 ms, enqueue 0.277686 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615112 ms - Host latency: 0.670264 ms (end to end 1.16018 ms, enqueue 0.27876 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595483 ms - Host latency: 0.650391 ms (end to end 1.17239 ms, enqueue 0.279248 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627808 ms - Host latency: 0.682764 ms (end to end 1.20986 ms, enqueue 0.278101 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.604272 ms - Host latency: 0.658887 ms (end to end 1.16504 ms, enqueue 0.278198 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618433 ms - Host latency: 0.673193 ms (end to end 1.19302 ms, enqueue 0.277856 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615063 ms - Host latency: 0.67002 ms (end to end 1.16328 ms, enqueue 0.279077 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591064 ms - Host latency: 0.645483 ms (end to end 1.1606 ms, enqueue 0.275562 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615259 ms - Host latency: 0.670117 ms (end to end 1.18359 ms, enqueue 0.278491 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.618921 ms - Host latency: 0.676172 ms (end to end 1.17463 ms, enqueue 0.276587 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.596997 ms - Host latency: 0.651709 ms (end to end 1.16787 ms, enqueue 0.277539 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615308 ms - Host latency: 0.670166 ms (end to end 1.18601 ms, enqueue 0.279028 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593286 ms - Host latency: 0.648291 ms (end to end 1.14019 ms, enqueue 0.277881 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628003 ms - Host latency: 0.682861 ms (end to end 1.21467 ms, enqueue 0.277393 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621484 ms - Host latency: 0.676343 ms (end to end 1.17549 ms, enqueue 0.276855 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599365 ms - Host latency: 0.65415 ms (end to end 1.18279 ms, enqueue 0.275854 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611035 ms - Host latency: 0.665796 ms (end to end 1.17751 ms, enqueue 0.279077 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615771 ms - Host latency: 0.670288 ms (end to end 1.16965 ms, enqueue 0.27644 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586328 ms - Host latency: 0.641187 ms (end to end 1.14912 ms, enqueue 0.278906 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.626489 ms - Host latency: 0.680835 ms (end to end 1.18005 ms, enqueue 0.276367 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593628 ms - Host latency: 0.648584 ms (end to end 1.17019 ms, enqueue 0.280029 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612866 ms - Host latency: 0.66792 ms (end to end 1.18125 ms, enqueue 0.278955 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613672 ms - Host latency: 0.668408 ms (end to end 1.15916 ms, enqueue 0.278296 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599023 ms - Host latency: 0.653882 ms (end to end 1.1772 ms, enqueue 0.278784 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623145 ms - Host latency: 0.677734 ms (end to end 1.20442 ms, enqueue 0.276416 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59939 ms - Host latency: 0.654443 ms (end to end 1.15632 ms, enqueue 0.27688 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617822 ms - Host latency: 0.672437 ms (end to end 1.18911 ms, enqueue 0.278076 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614795 ms - Host latency: 0.66958 ms (end to end 1.16152 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585718 ms - Host latency: 0.64043 ms (end to end 1.14858 ms, enqueue 0.279907 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613501 ms - Host latency: 0.668359 ms (end to end 1.18118 ms, enqueue 0.278467 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611279 ms - Host latency: 0.666187 ms (end to end 1.15999 ms, enqueue 0.276929 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588745 ms - Host latency: 0.643579 ms (end to end 1.1532 ms, enqueue 0.277832 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.608154 ms - Host latency: 0.663086 ms (end to end 1.1554 ms, enqueue 0.276904 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.597021 ms - Host latency: 0.651538 ms (end to end 1.17346 ms, enqueue 0.276074 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62771 ms - Host latency: 0.682983 ms (end to end 1.20325 ms, enqueue 0.279932 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.622925 ms - Host latency: 0.677612 ms (end to end 1.17673 ms, enqueue 0.278125 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598975 ms - Host latency: 0.653662 ms (end to end 1.18159 ms, enqueue 0.276611 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611548 ms - Host latency: 0.666431 ms (end to end 1.17708 ms, enqueue 0.277563 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589014 ms - Host latency: 0.643921 ms (end to end 1.13296 ms, enqueue 0.278369 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615894 ms - Host latency: 0.670825 ms (end to end 1.18987 ms, enqueue 0.276782 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.606567 ms - Host latency: 0.661328 ms (end to end 1.15181 ms, enqueue 0.276099 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590845 ms - Host latency: 0.645581 ms (end to end 1.15681 ms, enqueue 0.278003 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610937 ms - Host latency: 0.666016 ms (end to end 1.17566 ms, enqueue 0.280225 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589063 ms - Host latency: 0.643848 ms (end to end 1.13889 ms, enqueue 0.274341 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.631567 ms - Host latency: 0.686255 ms (end to end 1.22229 ms, enqueue 0.276904 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.625049 ms - Host latency: 0.679932 ms (end to end 1.17732 ms, enqueue 0.276514 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.597705 ms - Host latency: 0.653149 ms (end to end 1.17642 ms, enqueue 0.280444 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613916 ms - Host latency: 0.668994 ms (end to end 1.18218 ms, enqueue 0.27793 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619727 ms - Host latency: 0.674268 ms (end to end 1.17214 ms, enqueue 0.275977 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588574 ms - Host latency: 0.643188 ms (end to end 1.16128 ms, enqueue 0.276025 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611255 ms - Host latency: 0.666113 ms (end to end 1.17969 ms, enqueue 0.276929 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590625 ms - Host latency: 0.645557 ms (end to end 1.13687 ms, enqueue 0.278906 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.607764 ms - Host latency: 0.662646 ms (end to end 1.172 ms, enqueue 0.278223 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617578 ms - Host latency: 0.672241 ms (end to end 1.16758 ms, enqueue 0.278638 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.599268 ms - Host latency: 0.653784 ms (end to end 1.18733 ms, enqueue 0.274561 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627026 ms - Host latency: 0.681934 ms (end to end 1.20627 ms, enqueue 0.280542 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.600073 ms - Host latency: 0.656177 ms (end to end 1.16531 ms, enqueue 0.274854 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.620435 ms - Host latency: 0.675244 ms (end to end 1.18315 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61543 ms - Host latency: 0.670239 ms (end to end 1.16636 ms, enqueue 0.276294 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589209 ms - Host latency: 0.644043 ms (end to end 1.15276 ms, enqueue 0.278784 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613843 ms - Host latency: 0.668896 ms (end to end 1.18091 ms, enqueue 0.277881 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61604 ms - Host latency: 0.670776 ms (end to end 1.16384 ms, enqueue 0.276782 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585205 ms - Host latency: 0.640063 ms (end to end 1.15234 ms, enqueue 0.277808 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615332 ms - Host latency: 0.670239 ms (end to end 1.18948 ms, enqueue 0.276953 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594727 ms - Host latency: 0.649683 ms (end to end 1.14519 ms, enqueue 0.277905 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628589 ms - Host latency: 0.683691 ms (end to end 1.2124 ms, enqueue 0.27727 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623633 ms - Host latency: 0.678589 ms (end to end 1.18108 ms, enqueue 0.276563 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590479 ms - Host latency: 0.645142 ms (end to end 1.16025 ms, enqueue 0.278345 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61438 ms - Host latency: 0.66958 ms (end to end 1.18286 ms, enqueue 0.27854 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612134 ms - Host latency: 0.666064 ms (end to end 1.17151 ms, enqueue 0.270532 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.592627 ms - Host latency: 0.647461 ms (end to end 1.16086 ms, enqueue 0.278076 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617065 ms - Host latency: 0.671826 ms (end to end 1.1656 ms, enqueue 0.276196 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589648 ms - Host latency: 0.644507 ms (end to end 1.16025 ms, enqueue 0.278345 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611133 ms - Host latency: 0.666138 ms (end to end 1.17756 ms, enqueue 0.278735 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.617139 ms - Host latency: 0.67146 ms (end to end 1.1738 ms, enqueue 0.27312 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.59834 ms - Host latency: 0.652588 ms (end to end 1.18418 ms, enqueue 0.274634 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623291 ms - Host latency: 0.678223 ms (end to end 1.19988 ms, enqueue 0.279199 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.597705 ms - Host latency: 0.651733 ms (end to end 1.1667 ms, enqueue 0.268237 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.606543 ms - Host latency: 0.660962 ms (end to end 1.16768 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616943 ms - Host latency: 0.67168 ms (end to end 1.16562 ms, enqueue 0.278174 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.587256 ms - Host latency: 0.641748 ms (end to end 1.15935 ms, enqueue 0.274438 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616455 ms - Host latency: 0.67146 ms (end to end 1.18625 ms, enqueue 0.278857 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586865 ms - Host latency: 0.641382 ms (end to end 1.12886 ms, enqueue 0.27915 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615234 ms - Host latency: 0.669873 ms (end to end 1.18638 ms, enqueue 0.279077 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614697 ms - Host latency: 0.669604 ms (end to end 1.16746 ms, enqueue 0.27627 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.597876 ms - Host latency: 0.652661 ms (end to end 1.17136 ms, enqueue 0.277637 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.632129 ms - Host latency: 0.687134 ms (end to end 1.22048 ms, enqueue 0.278589 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623438 ms - Host latency: 0.678174 ms (end to end 1.17783 ms, enqueue 0.278467 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585718 ms - Host latency: 0.640405 ms (end to end 1.15015 ms, enqueue 0.278174 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615039 ms - Host latency: 0.66958 ms (end to end 1.18513 ms, enqueue 0.278491 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585938 ms - Host latency: 0.640649 ms (end to end 1.12839 ms, enqueue 0.277197 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619824 ms - Host latency: 0.674609 ms (end to end 1.19087 ms, enqueue 0.279346 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613574 ms - Host latency: 0.668433 ms (end to end 1.15752 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594678 ms - Host latency: 0.649585 ms (end to end 1.16782 ms, enqueue 0.277515 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610767 ms - Host latency: 0.666162 ms (end to end 1.17595 ms, enqueue 0.278687 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590405 ms - Host latency: 0.645288 ms (end to end 1.13477 ms, enqueue 0.278174 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.62439 ms - Host latency: 0.67937 ms (end to end 1.20723 ms, enqueue 0.276904 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.637256 ms - Host latency: 0.692554 ms (end to end 1.19163 ms, enqueue 0.27854 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.593433 ms - Host latency: 0.648389 ms (end to end 1.17969 ms, enqueue 0.278931 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610034 ms - Host latency: 0.664746 ms (end to end 1.17817 ms, enqueue 0.276172 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611475 ms - Host latency: 0.666162 ms (end to end 1.15928 ms, enqueue 0.276294 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586987 ms - Host latency: 0.641919 ms (end to end 1.14949 ms, enqueue 0.278638 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614209 ms - Host latency: 0.668848 ms (end to end 1.18564 ms, enqueue 0.276392 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589038 ms - Host latency: 0.643945 ms (end to end 1.13142 ms, enqueue 0.278809 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.60708 ms - Host latency: 0.661646 ms (end to end 1.17522 ms, enqueue 0.275977 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613696 ms - Host latency: 0.668726 ms (end to end 1.16084 ms, enqueue 0.2771 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598779 ms - Host latency: 0.653467 ms (end to end 1.18174 ms, enqueue 0.27605 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.621094 ms - Host latency: 0.676196 ms (end to end 1.19497 ms, enqueue 0.280005 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610718 ms - Host latency: 0.665234 ms (end to end 1.18909 ms, enqueue 0.271411 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611328 ms - Host latency: 0.665698 ms (end to end 1.18042 ms, enqueue 0.276147 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614478 ms - Host latency: 0.668994 ms (end to end 1.16748 ms, enqueue 0.277002 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594531 ms - Host latency: 0.649121 ms (end to end 1.16545 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613843 ms - Host latency: 0.668408 ms (end to end 1.1832 ms, enqueue 0.277539 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615991 ms - Host latency: 0.670801 ms (end to end 1.16865 ms, enqueue 0.276611 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.5948 ms - Host latency: 0.649805 ms (end to end 1.1678 ms, enqueue 0.276733 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.609766 ms - Host latency: 0.664551 ms (end to end 1.17908 ms, enqueue 0.27627 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598975 ms - Host latency: 0.654492 ms (end to end 1.15095 ms, enqueue 0.278809 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628833 ms - Host latency: 0.683984 ms (end to end 1.2114 ms, enqueue 0.280005 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.63479 ms - Host latency: 0.689966 ms (end to end 1.1927 ms, enqueue 0.278589 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590234 ms - Host latency: 0.644727 ms (end to end 1.17017 ms, enqueue 0.276099 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611963 ms - Host latency: 0.666772 ms (end to end 1.17864 ms, enqueue 0.278711 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614526 ms - Host latency: 0.669067 ms (end to end 1.1614 ms, enqueue 0.276489 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.592969 ms - Host latency: 0.647754 ms (end to end 1.16143 ms, enqueue 0.280518 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610596 ms - Host latency: 0.665479 ms (end to end 1.15183 ms, enqueue 0.278687 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.592676 ms - Host latency: 0.647559 ms (end to end 1.16677 ms, enqueue 0.276147 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.612158 ms - Host latency: 0.667017 ms (end to end 1.18223 ms, enqueue 0.27583 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615625 ms - Host latency: 0.67063 ms (end to end 1.16196 ms, enqueue 0.278149 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.604272 ms - Host latency: 0.659058 ms (end to end 1.19238 ms, enqueue 0.27605 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.622998 ms - Host latency: 0.677856 ms (end to end 1.201 ms, enqueue 0.27937 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590234 ms - Host latency: 0.645068 ms (end to end 1.1335 ms, enqueue 0.277588 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.607715 ms - Host latency: 0.662427 ms (end to end 1.17268 ms, enqueue 0.27644 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613477 ms - Host latency: 0.668188 ms (end to end 1.15776 ms, enqueue 0.278271 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590479 ms - Host latency: 0.645435 ms (end to end 1.16028 ms, enqueue 0.279126 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613501 ms - Host latency: 0.668384 ms (end to end 1.18242 ms, enqueue 0.277783 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.590601 ms - Host latency: 0.645312 ms (end to end 1.13982 ms, enqueue 0.276025 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.616211 ms - Host latency: 0.670923 ms (end to end 1.1917 ms, enqueue 0.276172 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.611475 ms - Host latency: 0.666113 ms (end to end 1.1562 ms, enqueue 0.276343 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.598828 ms - Host latency: 0.654492 ms (end to end 1.17715 ms, enqueue 0.278418 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.627539 ms - Host latency: 0.682544 ms (end to end 1.20605 ms, enqueue 0.280396 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623047 ms - Host latency: 0.677734 ms (end to end 1.18025 ms, enqueue 0.276367 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.585693 ms - Host latency: 0.640186 ms (end to end 1.15251 ms, enqueue 0.278687 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.623926 ms - Host latency: 0.678467 ms (end to end 1.20557 ms, enqueue 0.276978 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.588452 ms - Host latency: 0.643359 ms (end to end 1.13225 ms, enqueue 0.278149 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613672 ms - Host latency: 0.668164 ms (end to end 1.18276 ms, enqueue 0.278687 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614893 ms - Host latency: 0.669629 ms (end to end 1.1635 ms, enqueue 0.278516 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.587109 ms - Host latency: 0.641675 ms (end to end 1.15486 ms, enqueue 0.276172 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613403 ms - Host latency: 0.668481 ms (end to end 1.18503 ms, enqueue 0.276294 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.624194 ms - Host latency: 0.679175 ms (end to end 1.18013 ms, enqueue 0.277979 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595801 ms - Host latency: 0.650635 ms (end to end 1.17195 ms, enqueue 0.278833 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.619751 ms - Host latency: 0.674585 ms (end to end 1.17092 ms, enqueue 0.278516 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589331 ms - Host latency: 0.643652 ms (end to end 1.16172 ms, enqueue 0.27644 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61123 ms - Host latency: 0.666016 ms (end to end 1.17991 ms, enqueue 0.275732 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61084 ms - Host latency: 0.665576 ms (end to end 1.15503 ms, enqueue 0.276978 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.589868 ms - Host latency: 0.644482 ms (end to end 1.15696 ms, enqueue 0.278564 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.615771 ms - Host latency: 0.670264 ms (end to end 1.19084 ms, enqueue 0.276099 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.586475 ms - Host latency: 0.641797 ms (end to end 1.13127 ms, enqueue 0.276782 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.614307 ms - Host latency: 0.668994 ms (end to end 1.17991 ms, enqueue 0.279468 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.626147 ms - Host latency: 0.681055 ms (end to end 1.17969 ms, enqueue 0.278955 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.595166 ms - Host latency: 0.650146 ms (end to end 1.17837 ms, enqueue 0.27561 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.628833 ms - Host latency: 0.683789 ms (end to end 1.21287 ms, enqueue 0.278564 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.594678 ms - Host latency: 0.649561 ms (end to end 1.14587 ms, enqueue 0.276831 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.61167 ms - Host latency: 0.666333 ms (end to end 1.18159 ms, enqueue 0.276465 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.610425 ms - Host latency: 0.665234 ms (end to end 1.15498 ms, enqueue 0.27876 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.591919 ms - Host latency: 0.646436 ms (end to end 1.16216 ms, enqueue 0.275903 ms) [05/21/2021-05:50:40] [I] Average on 10 runs - GPU latency: 0.613379 ms - Host latency: 0.668018 ms (end to end 1.18569 ms, enqueue 0.277051 ms) [05/21/2021-05:50:40] [I] [05/21/2021-05:50:40] [I] === Performance summary === [05/21/2021-05:50:40] [I] Throughput: 1616.81 qps [05/21/2021-05:50:40] [I] Latency: min = 0.594513 ms, max = 3.01379 ms, mean = 0.671275 ms, median = 0.599609 ms, percentile(99%) = 0.906616 ms [05/21/2021-05:50:40] [I] End-to-End Host Latency: min = 0.96814 ms, max = 3.49133 ms, mean = 1.19226 ms, median = 1.24463 ms, percentile(99%) = 1.44238 ms [05/21/2021-05:50:40] [I] Enqueue Time: min = 0.255981 ms, max = 1.08929 ms, mean = 0.27753 ms, median = 0.279419 ms, percentile(99%) = 0.288727 ms [05/21/2021-05:50:40] [I] H2D Latency: min = 0.048645 ms, max = 0.0969238 ms, mean = 0.05141 ms, median = 0.0515137 ms, percentile(99%) = 0.0529785 ms [05/21/2021-05:50:40] [I] GPU Compute Time: min = 0.541504 ms, max = 2.96045 ms, mean = 0.616471 ms, median = 0.5448 ms, percentile(99%) = 0.850952 ms [05/21/2021-05:50:40] [I] D2H Latency: min = 0.00262451 ms, max = 0.0292969 ms, mean = 0.00339516 ms, median = 0.00317383 ms, percentile(99%) = 0.00445557 ms [05/21/2021-05:50:40] [I] Total Host Walltime: 3.00158 s [05/21/2021-05:50:40] [I] Total GPU Compute Time: 2.99174 s [05/21/2021-05:50:40] [I] Explanations of the performance metrics are printed in the verbose logs. [05/21/2021-05:50:40] [V] [05/21/2021-05:50:40] [V] === Explanations of the performance metrics === [05/21/2021-05:50:40] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [05/21/2021-05:50:40] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [05/21/2021-05:50:40] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [05/21/2021-05:50:40] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [05/21/2021-05:50:40] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [05/21/2021-05:50:40] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [05/21/2021-05:50:40] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [05/21/2021-05:50:40] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [05/21/2021-05:50:40] [V] End-to-End Host Latency: the duration from when the H2D of a query is called to when the D2H of the same query is completed, which includes the latency to wait for the completion of the previous query. This is the latency of a query if multiple queries are enqueued consecutively. [05/21/2021-05:50:40] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=resnet50-original-symbol.onnx --fp16 --sparsity=disable --workspace=8192 --verbose [05/21/2021-05:50:40] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2285, GPU 11574 (MiB)