&&&& RUNNING TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=resnet50-original-symbol.onnx --fp16 --sparsity=force --workspace=8192 --verbose --dumpProfile --separateProfileRun
[05/21/2021-07:41:30] [I] === Model Options ===
[05/21/2021-07:41:30] [I] Format: ONNX
[05/21/2021-07:41:30] [I] Model: resnet50-original-symbol.onnx
[05/21/2021-07:41:30] [I] Output:
[05/21/2021-07:41:30] [I] === Build Options ===
[05/21/2021-07:41:30] [I] Max batch: explicit
[05/21/2021-07:41:30] [I] Workspace: 8192 MiB
[05/21/2021-07:41:30] [I] minTiming: 1
[05/21/2021-07:41:30] [I] avgTiming: 8
[05/21/2021-07:41:30] [I] Precision: FP32+FP16
[05/21/2021-07:41:30] [I] Calibration: 
[05/21/2021-07:41:30] [I] Refit: Disabled
[05/21/2021-07:41:30] [I] Sparsity: Forced
[05/21/2021-07:41:30] [I] Safe mode: Disabled
[05/21/2021-07:41:30] [I] Enable serialization: Disabled
[05/21/2021-07:41:30] [I] Save engine: 
[05/21/2021-07:41:30] [I] Load engine: 
[05/21/2021-07:41:30] [I] NVTX verbosity: 0
[05/21/2021-07:41:30] [I] Tactic sources: Using default tactic sources
[05/21/2021-07:41:30] [I] timingCacheMode: local
[05/21/2021-07:41:30] [I] timingCacheFile: 
[05/21/2021-07:41:30] [I] Input(s)s format: fp32:CHW
[05/21/2021-07:41:30] [I] Output(s)s format: fp32:CHW
[05/21/2021-07:41:30] [I] Input build shapes: model
[05/21/2021-07:41:30] [I] Input calibration shapes: model
[05/21/2021-07:41:30] [I] === System Options ===
[05/21/2021-07:41:30] [I] Device: 0
[05/21/2021-07:41:30] [I] DLACore: 
[05/21/2021-07:41:30] [I] Plugins:
[05/21/2021-07:41:30] [I] === Inference Options ===
[05/21/2021-07:41:30] [I] Batch: Explicit
[05/21/2021-07:41:30] [I] Input inference shapes: model
[05/21/2021-07:41:30] [I] Iterations: 10
[05/21/2021-07:41:30] [I] Duration: 3s (+ 200ms warm up)
[05/21/2021-07:41:30] [I] Sleep time: 0ms
[05/21/2021-07:41:30] [I] Streams: 1
[05/21/2021-07:41:30] [I] ExposeDMA: Disabled
[05/21/2021-07:41:30] [I] Data transfers: Enabled
[05/21/2021-07:41:30] [I] Spin-wait: Disabled
[05/21/2021-07:41:30] [I] Multithreading: Disabled
[05/21/2021-07:41:30] [I] CUDA Graph: Disabled
[05/21/2021-07:41:30] [I] Separate profiling: Enabled
[05/21/2021-07:41:30] [I] Time Deserialize: Disabled
[05/21/2021-07:41:30] [I] Time Refit: Disabled
[05/21/2021-07:41:30] [I] Skip inference: Disabled
[05/21/2021-07:41:30] [I] Inputs:
[05/21/2021-07:41:30] [I] === Reporting Options ===
[05/21/2021-07:41:30] [I] Verbose: Enabled
[05/21/2021-07:41:30] [I] Averages: 10 inferences
[05/21/2021-07:41:30] [I] Percentile: 99
[05/21/2021-07:41:30] [I] Dump refittable layers:Disabled
[05/21/2021-07:41:30] [I] Dump output: Disabled
[05/21/2021-07:41:30] [I] Profile: Enabled
[05/21/2021-07:41:30] [I] Export timing to JSON file: 
[05/21/2021-07:41:30] [I] Export output to JSON file: 
[05/21/2021-07:41:30] [I] Export profile to JSON file: 
[05/21/2021-07:41:30] [I] 
[05/21/2021-07:41:31] [I] === Device Information ===
[05/21/2021-07:41:31] [I] Selected Device: GeForce RTX 3090
[05/21/2021-07:41:31] [I] Compute Capability: 8.6
[05/21/2021-07:41:31] [I] SMs: 82
[05/21/2021-07:41:31] [I] Compute Clock Rate: 1.755 GHz
[05/21/2021-07:41:31] [I] Device Global Memory: 24268 MiB
[05/21/2021-07:41:31] [I] Shared Memory per SM: 100 KiB
[05/21/2021-07:41:31] [I] Memory Bus Width: 384 bits (ECC disabled)
[05/21/2021-07:41:31] [I] Memory Clock Rate: 9.751 GHz
[05/21/2021-07:41:31] [I] 
[05/21/2021-07:41:31] [I] TensorRT version: 8000
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Proposal version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::Split version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[05/21/2021-07:41:31] [I] [TRT] [MemUsageChange] Init CUDA: CPU +441, GPU +0, now: CPU 447, GPU 10788 (MiB)
[05/21/2021-07:41:31] [I] [TRT] ----------------------------------------------------------------
[05/21/2021-07:41:31] [I] [TRT] Input filename:   resnet50-original-symbol.onnx
[05/21/2021-07:41:31] [I] [TRT] ONNX IR version:  0.0.3
[05/21/2021-07:41:31] [I] [TRT] Opset version:    8
[05/21/2021-07:41:31] [I] [TRT] Producer name:    
[05/21/2021-07:41:31] [I] [TRT] Producer version: 
[05/21/2021-07:41:31] [I] [TRT] Domain:           
[05/21/2021-07:41:31] [I] [TRT] Model version:    0
[05/21/2021-07:41:31] [I] [TRT] Doc string:       
[05/21/2021-07:41:31] [I] [TRT] ----------------------------------------------------------------
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::Split version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[05/21/2021-07:41:31] [V] [TRT] Adding network input: data with dtype: float32, dimensions: (1, 3, 224, 224)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: data for ONNX tensor: data
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn_data_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn_data_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn_data_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn_data_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: conv0_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn0_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn0_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn0_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn0_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit2_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage1_unit3_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit2_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit3_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage2_unit4_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit2_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit3_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit4_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit5_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage3_unit6_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit2_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: stage4_unit3_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: fc1_weight
[05/21/2021-07:41:31] [V] [TRT] Importing initializer: fc1_bias
[05/21/2021-07:41:31] [V] [TRT] Parsing node: cast0 [Cast]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: data
[05/21/2021-07:41:31] [V] [TRT] cast0 [Cast] inputs: [data -> (1, 3, 224, 224)], 
[05/21/2021-07:41:31] [V] [TRT] Casting to type: float16
[05/21/2021-07:41:31] [W] [TRT] Tensor DataType is determined at build time for tensors not marked as input or output.
[05/21/2021-07:41:31] [V] [TRT] Registering layer: cast0 for ONNX node: cast0
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: cast0 for ONNX tensor: cast0
[05/21/2021-07:41:31] [V] [TRT] cast0 [Cast] outputs: [cast0 -> (1, 3, 224, 224)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: bn_data [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: cast0
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn_data_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn_data_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn_data_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn_data_moving_var
[05/21/2021-07:41:31] [V] [TRT] bn_data [BatchNormalization] inputs: [cast0 -> (1, 3, 224, 224)], [bn_data_gamma -> (3)], [bn_data_beta -> (3)], [bn_data_moving_mean -> (3)], [bn_data_moving_var -> (3)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: bn_data for ONNX node: bn_data
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: bn_data for ONNX tensor: bn_data
[05/21/2021-07:41:31] [V] [TRT] bn_data [BatchNormalization] outputs: [bn_data -> (1, 3, 224, 224)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: conv0 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn_data
[05/21/2021-07:41:31] [V] [TRT] Searching for input: conv0_weight
[05/21/2021-07:41:31] [V] [TRT] conv0 [Conv] inputs: [bn_data -> (1, 3, 224, 224)], [conv0_weight -> (64, 3, 7, 7)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 3, 224, 224)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: conv0 for ONNX node: conv0
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 112, 112)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: conv0 for ONNX tensor: conv0
[05/21/2021-07:41:31] [V] [TRT] conv0 [Conv] outputs: [conv0 -> (1, 64, 112, 112)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: bn0 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: conv0
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn0_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn0_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn0_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn0_moving_var
[05/21/2021-07:41:31] [V] [TRT] bn0 [BatchNormalization] inputs: [conv0 -> (1, 64, 112, 112)], [bn0_gamma -> (64)], [bn0_beta -> (64)], [bn0_moving_mean -> (64)], [bn0_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: bn0 for ONNX node: bn0
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: bn0 for ONNX tensor: bn0
[05/21/2021-07:41:31] [V] [TRT] bn0 [BatchNormalization] outputs: [bn0 -> (1, 64, 112, 112)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: relu0 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: bn0
[05/21/2021-07:41:31] [V] [TRT] relu0 [Relu] inputs: [bn0 -> (1, 64, 112, 112)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: relu0 for ONNX node: relu0
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: relu0 for ONNX tensor: relu0
[05/21/2021-07:41:31] [V] [TRT] relu0 [Relu] outputs: [relu0 -> (1, 64, 112, 112)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: pooling0 [MaxPool]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: relu0
[05/21/2021-07:41:31] [V] [TRT] pooling0 [MaxPool] inputs: [relu0 -> (1, 64, 112, 112)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: pooling0 for ONNX node: pooling0
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: pooling0 for ONNX tensor: pooling0
[05/21/2021-07:41:31] [V] [TRT] pooling0 [MaxPool] outputs: [pooling0 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_bn1 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: pooling0
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn1 [BatchNormalization] inputs: [pooling0 -> (1, 64, 56, 56)], [stage1_unit1_bn1_gamma -> (64)], [stage1_unit1_bn1_beta -> (64)], [stage1_unit1_bn1_moving_mean -> (64)], [stage1_unit1_bn1_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_bn1 for ONNX node: stage1_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_bn1 for ONNX tensor: stage1_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn1 [BatchNormalization] outputs: [stage1_unit1_bn1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_relu1 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu1 [Relu] inputs: [stage1_unit1_bn1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_relu1 for ONNX node: stage1_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_relu1 for ONNX tensor: stage1_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu1 [Relu] outputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_conv1 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv1 [Conv] inputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], [stage1_unit1_conv1_weight -> (64, 64, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_conv1 for ONNX node: stage1_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_conv1 for ONNX tensor: stage1_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv1 [Conv] outputs: [stage1_unit1_conv1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_bn2 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn2 [BatchNormalization] inputs: [stage1_unit1_conv1 -> (1, 64, 56, 56)], [stage1_unit1_bn2_gamma -> (64)], [stage1_unit1_bn2_beta -> (64)], [stage1_unit1_bn2_moving_mean -> (64)], [stage1_unit1_bn2_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_bn2 for ONNX node: stage1_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_bn2 for ONNX tensor: stage1_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn2 [BatchNormalization] outputs: [stage1_unit1_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_relu2 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu2 [Relu] inputs: [stage1_unit1_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_relu2 for ONNX node: stage1_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_relu2 for ONNX tensor: stage1_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu2 [Relu] outputs: [stage1_unit1_relu2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_conv2 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv2 [Conv] inputs: [stage1_unit1_relu2 -> (1, 64, 56, 56)], [stage1_unit1_conv2_weight -> (64, 64, 3, 3)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_conv2 for ONNX node: stage1_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_conv2 for ONNX tensor: stage1_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv2 [Conv] outputs: [stage1_unit1_conv2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_bn3 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn3 [BatchNormalization] inputs: [stage1_unit1_conv2 -> (1, 64, 56, 56)], [stage1_unit1_bn3_gamma -> (64)], [stage1_unit1_bn3_beta -> (64)], [stage1_unit1_bn3_moving_mean -> (64)], [stage1_unit1_bn3_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_bn3 for ONNX node: stage1_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_bn3 for ONNX tensor: stage1_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_bn3 [BatchNormalization] outputs: [stage1_unit1_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_relu3 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu3 [Relu] inputs: [stage1_unit1_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_relu3 for ONNX node: stage1_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_relu3 for ONNX tensor: stage1_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_relu3 [Relu] outputs: [stage1_unit1_relu3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_conv3 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv3 [Conv] inputs: [stage1_unit1_relu3 -> (1, 64, 56, 56)], [stage1_unit1_conv3_weight -> (256, 64, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_conv3 for ONNX node: stage1_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_conv3 for ONNX tensor: stage1_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_conv3 [Conv] outputs: [stage1_unit1_conv3 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit1_sc [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_sc [Conv] inputs: [stage1_unit1_relu1 -> (1, 64, 56, 56)], [stage1_unit1_sc_weight -> (256, 64, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit1_sc for ONNX node: stage1_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit1_sc for ONNX tensor: stage1_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] stage1_unit1_sc [Conv] outputs: [stage1_unit1_sc -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: _plus0 [Add]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] _plus0 [Add] inputs: [stage1_unit1_conv3 -> (1, 256, 56, 56)], [stage1_unit1_sc -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: _plus0 for ONNX node: _plus0
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: _plus0 for ONNX tensor: _plus0
[05/21/2021-07:41:31] [V] [TRT] _plus0 [Add] outputs: [_plus0 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_bn1 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus0
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn1 [BatchNormalization] inputs: [_plus0 -> (1, 256, 56, 56)], [stage1_unit2_bn1_gamma -> (256)], [stage1_unit2_bn1_beta -> (256)], [stage1_unit2_bn1_moving_mean -> (256)], [stage1_unit2_bn1_moving_var -> (256)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_bn1 for ONNX node: stage1_unit2_bn1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_bn1 for ONNX tensor: stage1_unit2_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn1 [BatchNormalization] outputs: [stage1_unit2_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_relu1 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu1 [Relu] inputs: [stage1_unit2_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_relu1 for ONNX node: stage1_unit2_relu1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_relu1 for ONNX tensor: stage1_unit2_relu1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu1 [Relu] outputs: [stage1_unit2_relu1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_conv1 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv1 [Conv] inputs: [stage1_unit2_relu1 -> (1, 256, 56, 56)], [stage1_unit2_conv1_weight -> (64, 256, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_conv1 for ONNX node: stage1_unit2_conv1
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_conv1 for ONNX tensor: stage1_unit2_conv1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv1 [Conv] outputs: [stage1_unit2_conv1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_bn2 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn2 [BatchNormalization] inputs: [stage1_unit2_conv1 -> (1, 64, 56, 56)], [stage1_unit2_bn2_gamma -> (64)], [stage1_unit2_bn2_beta -> (64)], [stage1_unit2_bn2_moving_mean -> (64)], [stage1_unit2_bn2_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_bn2 for ONNX node: stage1_unit2_bn2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_bn2 for ONNX tensor: stage1_unit2_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn2 [BatchNormalization] outputs: [stage1_unit2_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_relu2 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu2 [Relu] inputs: [stage1_unit2_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_relu2 for ONNX node: stage1_unit2_relu2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_relu2 for ONNX tensor: stage1_unit2_relu2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu2 [Relu] outputs: [stage1_unit2_relu2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_conv2 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_relu2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv2 [Conv] inputs: [stage1_unit2_relu2 -> (1, 64, 56, 56)], [stage1_unit2_conv2_weight -> (64, 64, 3, 3)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_conv2 for ONNX node: stage1_unit2_conv2
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_conv2 for ONNX tensor: stage1_unit2_conv2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv2 [Conv] outputs: [stage1_unit2_conv2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_bn3 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn3 [BatchNormalization] inputs: [stage1_unit2_conv2 -> (1, 64, 56, 56)], [stage1_unit2_bn3_gamma -> (64)], [stage1_unit2_bn3_beta -> (64)], [stage1_unit2_bn3_moving_mean -> (64)], [stage1_unit2_bn3_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_bn3 for ONNX node: stage1_unit2_bn3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_bn3 for ONNX tensor: stage1_unit2_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_bn3 [BatchNormalization] outputs: [stage1_unit2_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_relu3 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu3 [Relu] inputs: [stage1_unit2_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_relu3 for ONNX node: stage1_unit2_relu3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_relu3 for ONNX tensor: stage1_unit2_relu3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_relu3 [Relu] outputs: [stage1_unit2_relu3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit2_conv3 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_relu3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv3 [Conv] inputs: [stage1_unit2_relu3 -> (1, 64, 56, 56)], [stage1_unit2_conv3_weight -> (256, 64, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit2_conv3 for ONNX node: stage1_unit2_conv3
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit2_conv3 for ONNX tensor: stage1_unit2_conv3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit2_conv3 [Conv] outputs: [stage1_unit2_conv3 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: _plus1 [Add]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit2_conv3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus0
[05/21/2021-07:41:31] [V] [TRT] _plus1 [Add] inputs: [stage1_unit2_conv3 -> (1, 256, 56, 56)], [_plus0 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: _plus1 for ONNX node: _plus1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: _plus1 for ONNX tensor: _plus1
[05/21/2021-07:41:31] [V] [TRT] _plus1 [Add] outputs: [_plus1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_bn1 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn1 [BatchNormalization] inputs: [_plus1 -> (1, 256, 56, 56)], [stage1_unit3_bn1_gamma -> (256)], [stage1_unit3_bn1_beta -> (256)], [stage1_unit3_bn1_moving_mean -> (256)], [stage1_unit3_bn1_moving_var -> (256)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_bn1 for ONNX node: stage1_unit3_bn1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_bn1 for ONNX tensor: stage1_unit3_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn1 [BatchNormalization] outputs: [stage1_unit3_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_relu1 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu1 [Relu] inputs: [stage1_unit3_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_relu1 for ONNX node: stage1_unit3_relu1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_relu1 for ONNX tensor: stage1_unit3_relu1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu1 [Relu] outputs: [stage1_unit3_relu1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_conv1 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv1 [Conv] inputs: [stage1_unit3_relu1 -> (1, 256, 56, 56)], [stage1_unit3_conv1_weight -> (64, 256, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_conv1 for ONNX node: stage1_unit3_conv1
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_conv1 for ONNX tensor: stage1_unit3_conv1
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv1 [Conv] outputs: [stage1_unit3_conv1 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_bn2 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn2 [BatchNormalization] inputs: [stage1_unit3_conv1 -> (1, 64, 56, 56)], [stage1_unit3_bn2_gamma -> (64)], [stage1_unit3_bn2_beta -> (64)], [stage1_unit3_bn2_moving_mean -> (64)], [stage1_unit3_bn2_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_bn2 for ONNX node: stage1_unit3_bn2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_bn2 for ONNX tensor: stage1_unit3_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn2 [BatchNormalization] outputs: [stage1_unit3_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_relu2 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu2 [Relu] inputs: [stage1_unit3_bn2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_relu2 for ONNX node: stage1_unit3_relu2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_relu2 for ONNX tensor: stage1_unit3_relu2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu2 [Relu] outputs: [stage1_unit3_relu2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_conv2 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_relu2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv2 [Conv] inputs: [stage1_unit3_relu2 -> (1, 64, 56, 56)], [stage1_unit3_conv2_weight -> (64, 64, 3, 3)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_conv2 for ONNX node: stage1_unit3_conv2
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_conv2 for ONNX tensor: stage1_unit3_conv2
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv2 [Conv] outputs: [stage1_unit3_conv2 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_bn3 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn3 [BatchNormalization] inputs: [stage1_unit3_conv2 -> (1, 64, 56, 56)], [stage1_unit3_bn3_gamma -> (64)], [stage1_unit3_bn3_beta -> (64)], [stage1_unit3_bn3_moving_mean -> (64)], [stage1_unit3_bn3_moving_var -> (64)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_bn3 for ONNX node: stage1_unit3_bn3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_bn3 for ONNX tensor: stage1_unit3_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_bn3 [BatchNormalization] outputs: [stage1_unit3_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_relu3 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_bn3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu3 [Relu] inputs: [stage1_unit3_bn3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_relu3 for ONNX node: stage1_unit3_relu3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_relu3 for ONNX tensor: stage1_unit3_relu3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_relu3 [Relu] outputs: [stage1_unit3_relu3 -> (1, 64, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage1_unit3_conv3 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_relu3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv3 [Conv] inputs: [stage1_unit3_relu3 -> (1, 64, 56, 56)], [stage1_unit3_conv3_weight -> (256, 64, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 64, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage1_unit3_conv3 for ONNX node: stage1_unit3_conv3
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage1_unit3_conv3 for ONNX tensor: stage1_unit3_conv3
[05/21/2021-07:41:31] [V] [TRT] stage1_unit3_conv3 [Conv] outputs: [stage1_unit3_conv3 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: _plus2 [Add]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage1_unit3_conv3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus1
[05/21/2021-07:41:31] [V] [TRT] _plus2 [Add] inputs: [stage1_unit3_conv3 -> (1, 256, 56, 56)], [_plus1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: _plus2 for ONNX node: _plus2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: _plus2 for ONNX tensor: _plus2
[05/21/2021-07:41:31] [V] [TRT] _plus2 [Add] outputs: [_plus2 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_bn1 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn1 [BatchNormalization] inputs: [_plus2 -> (1, 256, 56, 56)], [stage2_unit1_bn1_gamma -> (256)], [stage2_unit1_bn1_beta -> (256)], [stage2_unit1_bn1_moving_mean -> (256)], [stage2_unit1_bn1_moving_var -> (256)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_bn1 for ONNX node: stage2_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_bn1 for ONNX tensor: stage2_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn1 [BatchNormalization] outputs: [stage2_unit1_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_relu1 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn1
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu1 [Relu] inputs: [stage2_unit1_bn1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_relu1 for ONNX node: stage2_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_relu1 for ONNX tensor: stage2_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu1 [Relu] outputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_conv1 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv1_weight
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv1 [Conv] inputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], [stage2_unit1_conv1_weight -> (128, 256, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_conv1 for ONNX node: stage2_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 128, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_conv1 for ONNX tensor: stage2_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv1 [Conv] outputs: [stage2_unit1_conv1 -> (1, 128, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_bn2 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn2_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn2_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn2_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn2_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn2 [BatchNormalization] inputs: [stage2_unit1_conv1 -> (1, 128, 56, 56)], [stage2_unit1_bn2_gamma -> (128)], [stage2_unit1_bn2_beta -> (128)], [stage2_unit1_bn2_moving_mean -> (128)], [stage2_unit1_bn2_moving_var -> (128)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_bn2 for ONNX node: stage2_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_bn2 for ONNX tensor: stage2_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn2 [BatchNormalization] outputs: [stage2_unit1_bn2 -> (1, 128, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_relu2 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn2
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu2 [Relu] inputs: [stage2_unit1_bn2 -> (1, 128, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_relu2 for ONNX node: stage2_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_relu2 for ONNX tensor: stage2_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu2 [Relu] outputs: [stage2_unit1_relu2 -> (1, 128, 56, 56)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_conv2 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_relu2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv2_weight
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv2 [Conv] inputs: [stage2_unit1_relu2 -> (1, 128, 56, 56)], [stage2_unit1_conv2_weight -> (128, 128, 3, 3)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 128, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_conv2 for ONNX node: stage2_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_conv2 for ONNX tensor: stage2_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv2 [Conv] outputs: [stage2_unit1_conv2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_bn3 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv2
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn3_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn3_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn3_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn3_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn3 [BatchNormalization] inputs: [stage2_unit1_conv2 -> (1, 128, 28, 28)], [stage2_unit1_bn3_gamma -> (128)], [stage2_unit1_bn3_beta -> (128)], [stage2_unit1_bn3_moving_mean -> (128)], [stage2_unit1_bn3_moving_var -> (128)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_bn3 for ONNX node: stage2_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_bn3 for ONNX tensor: stage2_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_bn3 [BatchNormalization] outputs: [stage2_unit1_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_relu3 [Relu]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_bn3
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu3 [Relu] inputs: [stage2_unit1_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_relu3 for ONNX node: stage2_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_relu3 for ONNX tensor: stage2_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_relu3 [Relu] outputs: [stage2_unit1_relu3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_conv3 [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_relu3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv3_weight
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv3 [Conv] inputs: [stage2_unit1_relu3 -> (1, 128, 28, 28)], [stage2_unit1_conv3_weight -> (512, 128, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_conv3 for ONNX node: stage2_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_conv3 for ONNX tensor: stage2_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_conv3 [Conv] outputs: [stage2_unit1_conv3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit1_sc [Conv]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_relu1
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_sc_weight
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_sc [Conv] inputs: [stage2_unit1_relu1 -> (1, 256, 56, 56)], [stage2_unit1_sc_weight -> (512, 256, 1, 1)], 
[05/21/2021-07:41:31] [V] [TRT] Convolution input dimensions: (1, 256, 56, 56)
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit1_sc for ONNX node: stage2_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:31] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit1_sc for ONNX tensor: stage2_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] stage2_unit1_sc [Conv] outputs: [stage2_unit1_sc -> (1, 512, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: _plus3 [Add]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_conv3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit1_sc
[05/21/2021-07:41:31] [V] [TRT] _plus3 [Add] inputs: [stage2_unit1_conv3 -> (1, 512, 28, 28)], [stage2_unit1_sc -> (1, 512, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: _plus3 for ONNX node: _plus3
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: _plus3 for ONNX tensor: _plus3
[05/21/2021-07:41:31] [V] [TRT] _plus3 [Add] outputs: [_plus3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:31] [V] [TRT] Parsing node: stage2_unit2_bn1 [BatchNormalization]
[05/21/2021-07:41:31] [V] [TRT] Searching for input: _plus3
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit2_bn1_gamma
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit2_bn1_beta
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit2_bn1_moving_mean
[05/21/2021-07:41:31] [V] [TRT] Searching for input: stage2_unit2_bn1_moving_var
[05/21/2021-07:41:31] [V] [TRT] stage2_unit2_bn1 [BatchNormalization] inputs: [_plus3 -> (1, 512, 28, 28)], [stage2_unit2_bn1_gamma -> (512)], [stage2_unit2_bn1_beta -> (512)], [stage2_unit2_bn1_moving_mean -> (512)], [stage2_unit2_bn1_moving_var -> (512)], 
[05/21/2021-07:41:31] [V] [TRT] Registering layer: stage2_unit2_bn1 for ONNX node: stage2_unit2_bn1
[05/21/2021-07:41:31] [V] [TRT] Registering tensor: stage2_unit2_bn1 for ONNX tensor: stage2_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_bn1 [BatchNormalization] outputs: [stage2_unit2_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu1 [Relu] inputs: [stage2_unit2_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_relu1 for ONNX node: stage2_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_relu1 for ONNX tensor: stage2_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu1 [Relu] outputs: [stage2_unit2_relu1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv1 [Conv] inputs: [stage2_unit2_relu1 -> (1, 512, 28, 28)], [stage2_unit2_conv1_weight -> (128, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_conv1 for ONNX node: stage2_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_conv1 for ONNX tensor: stage2_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv1 [Conv] outputs: [stage2_unit2_conv1 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_bn2 [BatchNormalization] inputs: [stage2_unit2_conv1 -> (1, 128, 28, 28)], [stage2_unit2_bn2_gamma -> (128)], [stage2_unit2_bn2_beta -> (128)], [stage2_unit2_bn2_moving_mean -> (128)], [stage2_unit2_bn2_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_bn2 for ONNX node: stage2_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_bn2 for ONNX tensor: stage2_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_bn2 [BatchNormalization] outputs: [stage2_unit2_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu2 [Relu] inputs: [stage2_unit2_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_relu2 for ONNX node: stage2_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_relu2 for ONNX tensor: stage2_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu2 [Relu] outputs: [stage2_unit2_relu2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv2 [Conv] inputs: [stage2_unit2_relu2 -> (1, 128, 28, 28)], [stage2_unit2_conv2_weight -> (128, 128, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_conv2 for ONNX node: stage2_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_conv2 for ONNX tensor: stage2_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv2 [Conv] outputs: [stage2_unit2_conv2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_bn3 [BatchNormalization] inputs: [stage2_unit2_conv2 -> (1, 128, 28, 28)], [stage2_unit2_bn3_gamma -> (128)], [stage2_unit2_bn3_beta -> (128)], [stage2_unit2_bn3_moving_mean -> (128)], [stage2_unit2_bn3_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_bn3 for ONNX node: stage2_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_bn3 for ONNX tensor: stage2_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_bn3 [BatchNormalization] outputs: [stage2_unit2_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu3 [Relu] inputs: [stage2_unit2_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_relu3 for ONNX node: stage2_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_relu3 for ONNX tensor: stage2_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_relu3 [Relu] outputs: [stage2_unit2_relu3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit2_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv3 [Conv] inputs: [stage2_unit2_relu3 -> (1, 128, 28, 28)], [stage2_unit2_conv3_weight -> (512, 128, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit2_conv3 for ONNX node: stage2_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit2_conv3 for ONNX tensor: stage2_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit2_conv3 [Conv] outputs: [stage2_unit2_conv3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus4 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus3
[05/21/2021-07:41:32] [V] [TRT] _plus4 [Add] inputs: [stage2_unit2_conv3 -> (1, 512, 28, 28)], [_plus3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus4 for ONNX node: _plus4
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus4 for ONNX tensor: _plus4
[05/21/2021-07:41:32] [V] [TRT] _plus4 [Add] outputs: [_plus4 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus4
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn1 [BatchNormalization] inputs: [_plus4 -> (1, 512, 28, 28)], [stage2_unit3_bn1_gamma -> (512)], [stage2_unit3_bn1_beta -> (512)], [stage2_unit3_bn1_moving_mean -> (512)], [stage2_unit3_bn1_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_bn1 for ONNX node: stage2_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_bn1 for ONNX tensor: stage2_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn1 [BatchNormalization] outputs: [stage2_unit3_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu1 [Relu] inputs: [stage2_unit3_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_relu1 for ONNX node: stage2_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_relu1 for ONNX tensor: stage2_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu1 [Relu] outputs: [stage2_unit3_relu1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv1 [Conv] inputs: [stage2_unit3_relu1 -> (1, 512, 28, 28)], [stage2_unit3_conv1_weight -> (128, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_conv1 for ONNX node: stage2_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_conv1 for ONNX tensor: stage2_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv1 [Conv] outputs: [stage2_unit3_conv1 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn2 [BatchNormalization] inputs: [stage2_unit3_conv1 -> (1, 128, 28, 28)], [stage2_unit3_bn2_gamma -> (128)], [stage2_unit3_bn2_beta -> (128)], [stage2_unit3_bn2_moving_mean -> (128)], [stage2_unit3_bn2_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_bn2 for ONNX node: stage2_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_bn2 for ONNX tensor: stage2_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn2 [BatchNormalization] outputs: [stage2_unit3_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu2 [Relu] inputs: [stage2_unit3_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_relu2 for ONNX node: stage2_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_relu2 for ONNX tensor: stage2_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu2 [Relu] outputs: [stage2_unit3_relu2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv2 [Conv] inputs: [stage2_unit3_relu2 -> (1, 128, 28, 28)], [stage2_unit3_conv2_weight -> (128, 128, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_conv2 for ONNX node: stage2_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_conv2 for ONNX tensor: stage2_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv2 [Conv] outputs: [stage2_unit3_conv2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn3 [BatchNormalization] inputs: [stage2_unit3_conv2 -> (1, 128, 28, 28)], [stage2_unit3_bn3_gamma -> (128)], [stage2_unit3_bn3_beta -> (128)], [stage2_unit3_bn3_moving_mean -> (128)], [stage2_unit3_bn3_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_bn3 for ONNX node: stage2_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_bn3 for ONNX tensor: stage2_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_bn3 [BatchNormalization] outputs: [stage2_unit3_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu3 [Relu] inputs: [stage2_unit3_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_relu3 for ONNX node: stage2_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_relu3 for ONNX tensor: stage2_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_relu3 [Relu] outputs: [stage2_unit3_relu3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit3_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv3 [Conv] inputs: [stage2_unit3_relu3 -> (1, 128, 28, 28)], [stage2_unit3_conv3_weight -> (512, 128, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit3_conv3 for ONNX node: stage2_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit3_conv3 for ONNX tensor: stage2_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit3_conv3 [Conv] outputs: [stage2_unit3_conv3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus5 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus4
[05/21/2021-07:41:32] [V] [TRT] _plus5 [Add] inputs: [stage2_unit3_conv3 -> (1, 512, 28, 28)], [_plus4 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus5 for ONNX node: _plus5
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus5 for ONNX tensor: _plus5
[05/21/2021-07:41:32] [V] [TRT] _plus5 [Add] outputs: [_plus5 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus5
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn1 [BatchNormalization] inputs: [_plus5 -> (1, 512, 28, 28)], [stage2_unit4_bn1_gamma -> (512)], [stage2_unit4_bn1_beta -> (512)], [stage2_unit4_bn1_moving_mean -> (512)], [stage2_unit4_bn1_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_bn1 for ONNX node: stage2_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_bn1 for ONNX tensor: stage2_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn1 [BatchNormalization] outputs: [stage2_unit4_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu1 [Relu] inputs: [stage2_unit4_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_relu1 for ONNX node: stage2_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_relu1 for ONNX tensor: stage2_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu1 [Relu] outputs: [stage2_unit4_relu1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv1 [Conv] inputs: [stage2_unit4_relu1 -> (1, 512, 28, 28)], [stage2_unit4_conv1_weight -> (128, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_conv1 for ONNX node: stage2_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_conv1 for ONNX tensor: stage2_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv1 [Conv] outputs: [stage2_unit4_conv1 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn2 [BatchNormalization] inputs: [stage2_unit4_conv1 -> (1, 128, 28, 28)], [stage2_unit4_bn2_gamma -> (128)], [stage2_unit4_bn2_beta -> (128)], [stage2_unit4_bn2_moving_mean -> (128)], [stage2_unit4_bn2_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_bn2 for ONNX node: stage2_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_bn2 for ONNX tensor: stage2_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn2 [BatchNormalization] outputs: [stage2_unit4_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu2 [Relu] inputs: [stage2_unit4_bn2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_relu2 for ONNX node: stage2_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_relu2 for ONNX tensor: stage2_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu2 [Relu] outputs: [stage2_unit4_relu2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv2 [Conv] inputs: [stage2_unit4_relu2 -> (1, 128, 28, 28)], [stage2_unit4_conv2_weight -> (128, 128, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_conv2 for ONNX node: stage2_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_conv2 for ONNX tensor: stage2_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv2 [Conv] outputs: [stage2_unit4_conv2 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn3 [BatchNormalization] inputs: [stage2_unit4_conv2 -> (1, 128, 28, 28)], [stage2_unit4_bn3_gamma -> (128)], [stage2_unit4_bn3_beta -> (128)], [stage2_unit4_bn3_moving_mean -> (128)], [stage2_unit4_bn3_moving_var -> (128)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_bn3 for ONNX node: stage2_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_bn3 for ONNX tensor: stage2_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_bn3 [BatchNormalization] outputs: [stage2_unit4_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu3 [Relu] inputs: [stage2_unit4_bn3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_relu3 for ONNX node: stage2_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_relu3 for ONNX tensor: stage2_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_relu3 [Relu] outputs: [stage2_unit4_relu3 -> (1, 128, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage2_unit4_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv3 [Conv] inputs: [stage2_unit4_relu3 -> (1, 128, 28, 28)], [stage2_unit4_conv3_weight -> (512, 128, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 128, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage2_unit4_conv3 for ONNX node: stage2_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage2_unit4_conv3 for ONNX tensor: stage2_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] stage2_unit4_conv3 [Conv] outputs: [stage2_unit4_conv3 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus6 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage2_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus5
[05/21/2021-07:41:32] [V] [TRT] _plus6 [Add] inputs: [stage2_unit4_conv3 -> (1, 512, 28, 28)], [_plus5 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus6 for ONNX node: _plus6
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus6 for ONNX tensor: _plus6
[05/21/2021-07:41:32] [V] [TRT] _plus6 [Add] outputs: [_plus6 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus6
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn1 [BatchNormalization] inputs: [_plus6 -> (1, 512, 28, 28)], [stage3_unit1_bn1_gamma -> (512)], [stage3_unit1_bn1_beta -> (512)], [stage3_unit1_bn1_moving_mean -> (512)], [stage3_unit1_bn1_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_bn1 for ONNX node: stage3_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_bn1 for ONNX tensor: stage3_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn1 [BatchNormalization] outputs: [stage3_unit1_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu1 [Relu] inputs: [stage3_unit1_bn1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_relu1 for ONNX node: stage3_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_relu1 for ONNX tensor: stage3_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu1 [Relu] outputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv1 [Conv] inputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], [stage3_unit1_conv1_weight -> (256, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_conv1 for ONNX node: stage3_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_conv1 for ONNX tensor: stage3_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv1 [Conv] outputs: [stage3_unit1_conv1 -> (1, 256, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn2 [BatchNormalization] inputs: [stage3_unit1_conv1 -> (1, 256, 28, 28)], [stage3_unit1_bn2_gamma -> (256)], [stage3_unit1_bn2_beta -> (256)], [stage3_unit1_bn2_moving_mean -> (256)], [stage3_unit1_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_bn2 for ONNX node: stage3_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_bn2 for ONNX tensor: stage3_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn2 [BatchNormalization] outputs: [stage3_unit1_bn2 -> (1, 256, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu2 [Relu] inputs: [stage3_unit1_bn2 -> (1, 256, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_relu2 for ONNX node: stage3_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_relu2 for ONNX tensor: stage3_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu2 [Relu] outputs: [stage3_unit1_relu2 -> (1, 256, 28, 28)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv2 [Conv] inputs: [stage3_unit1_relu2 -> (1, 256, 28, 28)], [stage3_unit1_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_conv2 for ONNX node: stage3_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_conv2 for ONNX tensor: stage3_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv2 [Conv] outputs: [stage3_unit1_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn3 [BatchNormalization] inputs: [stage3_unit1_conv2 -> (1, 256, 14, 14)], [stage3_unit1_bn3_gamma -> (256)], [stage3_unit1_bn3_beta -> (256)], [stage3_unit1_bn3_moving_mean -> (256)], [stage3_unit1_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_bn3 for ONNX node: stage3_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_bn3 for ONNX tensor: stage3_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_bn3 [BatchNormalization] outputs: [stage3_unit1_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu3 [Relu] inputs: [stage3_unit1_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_relu3 for ONNX node: stage3_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_relu3 for ONNX tensor: stage3_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_relu3 [Relu] outputs: [stage3_unit1_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv3 [Conv] inputs: [stage3_unit1_relu3 -> (1, 256, 14, 14)], [stage3_unit1_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_conv3 for ONNX node: stage3_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_conv3 for ONNX tensor: stage3_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_conv3 [Conv] outputs: [stage3_unit1_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit1_sc [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_sc_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_sc [Conv] inputs: [stage3_unit1_relu1 -> (1, 512, 28, 28)], [stage3_unit1_sc_weight -> (1024, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 28, 28)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit1_sc for ONNX node: stage3_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit1_sc for ONNX tensor: stage3_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] stage3_unit1_sc [Conv] outputs: [stage3_unit1_sc -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus7 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] _plus7 [Add] inputs: [stage3_unit1_conv3 -> (1, 1024, 14, 14)], [stage3_unit1_sc -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus7 for ONNX node: _plus7
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus7 for ONNX tensor: _plus7
[05/21/2021-07:41:32] [V] [TRT] _plus7 [Add] outputs: [_plus7 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus7
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn1 [BatchNormalization] inputs: [_plus7 -> (1, 1024, 14, 14)], [stage3_unit2_bn1_gamma -> (1024)], [stage3_unit2_bn1_beta -> (1024)], [stage3_unit2_bn1_moving_mean -> (1024)], [stage3_unit2_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_bn1 for ONNX node: stage3_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_bn1 for ONNX tensor: stage3_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn1 [BatchNormalization] outputs: [stage3_unit2_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu1 [Relu] inputs: [stage3_unit2_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_relu1 for ONNX node: stage3_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_relu1 for ONNX tensor: stage3_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu1 [Relu] outputs: [stage3_unit2_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv1 [Conv] inputs: [stage3_unit2_relu1 -> (1, 1024, 14, 14)], [stage3_unit2_conv1_weight -> (256, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_conv1 for ONNX node: stage3_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_conv1 for ONNX tensor: stage3_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv1 [Conv] outputs: [stage3_unit2_conv1 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn2 [BatchNormalization] inputs: [stage3_unit2_conv1 -> (1, 256, 14, 14)], [stage3_unit2_bn2_gamma -> (256)], [stage3_unit2_bn2_beta -> (256)], [stage3_unit2_bn2_moving_mean -> (256)], [stage3_unit2_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_bn2 for ONNX node: stage3_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_bn2 for ONNX tensor: stage3_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn2 [BatchNormalization] outputs: [stage3_unit2_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu2 [Relu] inputs: [stage3_unit2_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_relu2 for ONNX node: stage3_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_relu2 for ONNX tensor: stage3_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu2 [Relu] outputs: [stage3_unit2_relu2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv2 [Conv] inputs: [stage3_unit2_relu2 -> (1, 256, 14, 14)], [stage3_unit2_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_conv2 for ONNX node: stage3_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_conv2 for ONNX tensor: stage3_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv2 [Conv] outputs: [stage3_unit2_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn3 [BatchNormalization] inputs: [stage3_unit2_conv2 -> (1, 256, 14, 14)], [stage3_unit2_bn3_gamma -> (256)], [stage3_unit2_bn3_beta -> (256)], [stage3_unit2_bn3_moving_mean -> (256)], [stage3_unit2_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_bn3 for ONNX node: stage3_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_bn3 for ONNX tensor: stage3_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_bn3 [BatchNormalization] outputs: [stage3_unit2_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu3 [Relu] inputs: [stage3_unit2_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_relu3 for ONNX node: stage3_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_relu3 for ONNX tensor: stage3_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_relu3 [Relu] outputs: [stage3_unit2_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit2_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv3 [Conv] inputs: [stage3_unit2_relu3 -> (1, 256, 14, 14)], [stage3_unit2_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit2_conv3 for ONNX node: stage3_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit2_conv3 for ONNX tensor: stage3_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit2_conv3 [Conv] outputs: [stage3_unit2_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus8 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus7
[05/21/2021-07:41:32] [V] [TRT] _plus8 [Add] inputs: [stage3_unit2_conv3 -> (1, 1024, 14, 14)], [_plus7 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus8 for ONNX node: _plus8
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus8 for ONNX tensor: _plus8
[05/21/2021-07:41:32] [V] [TRT] _plus8 [Add] outputs: [_plus8 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus8
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn1 [BatchNormalization] inputs: [_plus8 -> (1, 1024, 14, 14)], [stage3_unit3_bn1_gamma -> (1024)], [stage3_unit3_bn1_beta -> (1024)], [stage3_unit3_bn1_moving_mean -> (1024)], [stage3_unit3_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_bn1 for ONNX node: stage3_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_bn1 for ONNX tensor: stage3_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn1 [BatchNormalization] outputs: [stage3_unit3_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu1 [Relu] inputs: [stage3_unit3_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_relu1 for ONNX node: stage3_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_relu1 for ONNX tensor: stage3_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu1 [Relu] outputs: [stage3_unit3_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv1 [Conv] inputs: [stage3_unit3_relu1 -> (1, 1024, 14, 14)], [stage3_unit3_conv1_weight -> (256, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_conv1 for ONNX node: stage3_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_conv1 for ONNX tensor: stage3_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv1 [Conv] outputs: [stage3_unit3_conv1 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn2 [BatchNormalization] inputs: [stage3_unit3_conv1 -> (1, 256, 14, 14)], [stage3_unit3_bn2_gamma -> (256)], [stage3_unit3_bn2_beta -> (256)], [stage3_unit3_bn2_moving_mean -> (256)], [stage3_unit3_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_bn2 for ONNX node: stage3_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_bn2 for ONNX tensor: stage3_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn2 [BatchNormalization] outputs: [stage3_unit3_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu2 [Relu] inputs: [stage3_unit3_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_relu2 for ONNX node: stage3_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_relu2 for ONNX tensor: stage3_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu2 [Relu] outputs: [stage3_unit3_relu2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv2 [Conv] inputs: [stage3_unit3_relu2 -> (1, 256, 14, 14)], [stage3_unit3_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_conv2 for ONNX node: stage3_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_conv2 for ONNX tensor: stage3_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv2 [Conv] outputs: [stage3_unit3_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn3 [BatchNormalization] inputs: [stage3_unit3_conv2 -> (1, 256, 14, 14)], [stage3_unit3_bn3_gamma -> (256)], [stage3_unit3_bn3_beta -> (256)], [stage3_unit3_bn3_moving_mean -> (256)], [stage3_unit3_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_bn3 for ONNX node: stage3_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_bn3 for ONNX tensor: stage3_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_bn3 [BatchNormalization] outputs: [stage3_unit3_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu3 [Relu] inputs: [stage3_unit3_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_relu3 for ONNX node: stage3_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_relu3 for ONNX tensor: stage3_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_relu3 [Relu] outputs: [stage3_unit3_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit3_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv3 [Conv] inputs: [stage3_unit3_relu3 -> (1, 256, 14, 14)], [stage3_unit3_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit3_conv3 for ONNX node: stage3_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit3_conv3 for ONNX tensor: stage3_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit3_conv3 [Conv] outputs: [stage3_unit3_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus9 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit3_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus8
[05/21/2021-07:41:32] [V] [TRT] _plus9 [Add] inputs: [stage3_unit3_conv3 -> (1, 1024, 14, 14)], [_plus8 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus9 for ONNX node: _plus9
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus9 for ONNX tensor: _plus9
[05/21/2021-07:41:32] [V] [TRT] _plus9 [Add] outputs: [_plus9 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus9
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn1 [BatchNormalization] inputs: [_plus9 -> (1, 1024, 14, 14)], [stage3_unit4_bn1_gamma -> (1024)], [stage3_unit4_bn1_beta -> (1024)], [stage3_unit4_bn1_moving_mean -> (1024)], [stage3_unit4_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_bn1 for ONNX node: stage3_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_bn1 for ONNX tensor: stage3_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn1 [BatchNormalization] outputs: [stage3_unit4_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu1 [Relu] inputs: [stage3_unit4_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_relu1 for ONNX node: stage3_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_relu1 for ONNX tensor: stage3_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu1 [Relu] outputs: [stage3_unit4_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv1 [Conv] inputs: [stage3_unit4_relu1 -> (1, 1024, 14, 14)], [stage3_unit4_conv1_weight -> (256, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_conv1 for ONNX node: stage3_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_conv1 for ONNX tensor: stage3_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv1 [Conv] outputs: [stage3_unit4_conv1 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn2 [BatchNormalization] inputs: [stage3_unit4_conv1 -> (1, 256, 14, 14)], [stage3_unit4_bn2_gamma -> (256)], [stage3_unit4_bn2_beta -> (256)], [stage3_unit4_bn2_moving_mean -> (256)], [stage3_unit4_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_bn2 for ONNX node: stage3_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_bn2 for ONNX tensor: stage3_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn2 [BatchNormalization] outputs: [stage3_unit4_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu2 [Relu] inputs: [stage3_unit4_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_relu2 for ONNX node: stage3_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_relu2 for ONNX tensor: stage3_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu2 [Relu] outputs: [stage3_unit4_relu2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv2 [Conv] inputs: [stage3_unit4_relu2 -> (1, 256, 14, 14)], [stage3_unit4_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_conv2 for ONNX node: stage3_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_conv2 for ONNX tensor: stage3_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv2 [Conv] outputs: [stage3_unit4_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn3 [BatchNormalization] inputs: [stage3_unit4_conv2 -> (1, 256, 14, 14)], [stage3_unit4_bn3_gamma -> (256)], [stage3_unit4_bn3_beta -> (256)], [stage3_unit4_bn3_moving_mean -> (256)], [stage3_unit4_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_bn3 for ONNX node: stage3_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_bn3 for ONNX tensor: stage3_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_bn3 [BatchNormalization] outputs: [stage3_unit4_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu3 [Relu] inputs: [stage3_unit4_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_relu3 for ONNX node: stage3_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_relu3 for ONNX tensor: stage3_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_relu3 [Relu] outputs: [stage3_unit4_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit4_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv3 [Conv] inputs: [stage3_unit4_relu3 -> (1, 256, 14, 14)], [stage3_unit4_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit4_conv3 for ONNX node: stage3_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit4_conv3 for ONNX tensor: stage3_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit4_conv3 [Conv] outputs: [stage3_unit4_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus10 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit4_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus9
[05/21/2021-07:41:32] [V] [TRT] _plus10 [Add] inputs: [stage3_unit4_conv3 -> (1, 1024, 14, 14)], [_plus9 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus10 for ONNX node: _plus10
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus10 for ONNX tensor: _plus10
[05/21/2021-07:41:32] [V] [TRT] _plus10 [Add] outputs: [_plus10 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus10
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn1 [BatchNormalization] inputs: [_plus10 -> (1, 1024, 14, 14)], [stage3_unit5_bn1_gamma -> (1024)], [stage3_unit5_bn1_beta -> (1024)], [stage3_unit5_bn1_moving_mean -> (1024)], [stage3_unit5_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_bn1 for ONNX node: stage3_unit5_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_bn1 for ONNX tensor: stage3_unit5_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn1 [BatchNormalization] outputs: [stage3_unit5_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu1 [Relu] inputs: [stage3_unit5_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_relu1 for ONNX node: stage3_unit5_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_relu1 for ONNX tensor: stage3_unit5_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu1 [Relu] outputs: [stage3_unit5_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv1 [Conv] inputs: [stage3_unit5_relu1 -> (1, 1024, 14, 14)], [stage3_unit5_conv1_weight -> (256, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_conv1 for ONNX node: stage3_unit5_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_conv1 for ONNX tensor: stage3_unit5_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv1 [Conv] outputs: [stage3_unit5_conv1 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn2 [BatchNormalization] inputs: [stage3_unit5_conv1 -> (1, 256, 14, 14)], [stage3_unit5_bn2_gamma -> (256)], [stage3_unit5_bn2_beta -> (256)], [stage3_unit5_bn2_moving_mean -> (256)], [stage3_unit5_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_bn2 for ONNX node: stage3_unit5_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_bn2 for ONNX tensor: stage3_unit5_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn2 [BatchNormalization] outputs: [stage3_unit5_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu2 [Relu] inputs: [stage3_unit5_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_relu2 for ONNX node: stage3_unit5_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_relu2 for ONNX tensor: stage3_unit5_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu2 [Relu] outputs: [stage3_unit5_relu2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv2 [Conv] inputs: [stage3_unit5_relu2 -> (1, 256, 14, 14)], [stage3_unit5_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_conv2 for ONNX node: stage3_unit5_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_conv2 for ONNX tensor: stage3_unit5_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv2 [Conv] outputs: [stage3_unit5_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn3 [BatchNormalization] inputs: [stage3_unit5_conv2 -> (1, 256, 14, 14)], [stage3_unit5_bn3_gamma -> (256)], [stage3_unit5_bn3_beta -> (256)], [stage3_unit5_bn3_moving_mean -> (256)], [stage3_unit5_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_bn3 for ONNX node: stage3_unit5_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_bn3 for ONNX tensor: stage3_unit5_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_bn3 [BatchNormalization] outputs: [stage3_unit5_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu3 [Relu] inputs: [stage3_unit5_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_relu3 for ONNX node: stage3_unit5_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_relu3 for ONNX tensor: stage3_unit5_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_relu3 [Relu] outputs: [stage3_unit5_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit5_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv3 [Conv] inputs: [stage3_unit5_relu3 -> (1, 256, 14, 14)], [stage3_unit5_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit5_conv3 for ONNX node: stage3_unit5_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit5_conv3 for ONNX tensor: stage3_unit5_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit5_conv3 [Conv] outputs: [stage3_unit5_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus11 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit5_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus10
[05/21/2021-07:41:32] [V] [TRT] _plus11 [Add] inputs: [stage3_unit5_conv3 -> (1, 1024, 14, 14)], [_plus10 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus11 for ONNX node: _plus11
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus11 for ONNX tensor: _plus11
[05/21/2021-07:41:32] [V] [TRT] _plus11 [Add] outputs: [_plus11 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus11
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn1 [BatchNormalization] inputs: [_plus11 -> (1, 1024, 14, 14)], [stage3_unit6_bn1_gamma -> (1024)], [stage3_unit6_bn1_beta -> (1024)], [stage3_unit6_bn1_moving_mean -> (1024)], [stage3_unit6_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_bn1 for ONNX node: stage3_unit6_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_bn1 for ONNX tensor: stage3_unit6_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn1 [BatchNormalization] outputs: [stage3_unit6_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu1 [Relu] inputs: [stage3_unit6_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_relu1 for ONNX node: stage3_unit6_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_relu1 for ONNX tensor: stage3_unit6_relu1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu1 [Relu] outputs: [stage3_unit6_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv1 [Conv] inputs: [stage3_unit6_relu1 -> (1, 1024, 14, 14)], [stage3_unit6_conv1_weight -> (256, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_conv1 for ONNX node: stage3_unit6_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_conv1 for ONNX tensor: stage3_unit6_conv1
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv1 [Conv] outputs: [stage3_unit6_conv1 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn2 [BatchNormalization] inputs: [stage3_unit6_conv1 -> (1, 256, 14, 14)], [stage3_unit6_bn2_gamma -> (256)], [stage3_unit6_bn2_beta -> (256)], [stage3_unit6_bn2_moving_mean -> (256)], [stage3_unit6_bn2_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_bn2 for ONNX node: stage3_unit6_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_bn2 for ONNX tensor: stage3_unit6_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn2 [BatchNormalization] outputs: [stage3_unit6_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu2 [Relu] inputs: [stage3_unit6_bn2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_relu2 for ONNX node: stage3_unit6_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_relu2 for ONNX tensor: stage3_unit6_relu2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu2 [Relu] outputs: [stage3_unit6_relu2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv2 [Conv] inputs: [stage3_unit6_relu2 -> (1, 256, 14, 14)], [stage3_unit6_conv2_weight -> (256, 256, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_conv2 for ONNX node: stage3_unit6_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_conv2 for ONNX tensor: stage3_unit6_conv2
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv2 [Conv] outputs: [stage3_unit6_conv2 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn3 [BatchNormalization] inputs: [stage3_unit6_conv2 -> (1, 256, 14, 14)], [stage3_unit6_bn3_gamma -> (256)], [stage3_unit6_bn3_beta -> (256)], [stage3_unit6_bn3_moving_mean -> (256)], [stage3_unit6_bn3_moving_var -> (256)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_bn3 for ONNX node: stage3_unit6_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_bn3 for ONNX tensor: stage3_unit6_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_bn3 [BatchNormalization] outputs: [stage3_unit6_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_bn3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu3 [Relu] inputs: [stage3_unit6_bn3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_relu3 for ONNX node: stage3_unit6_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_relu3 for ONNX tensor: stage3_unit6_relu3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_relu3 [Relu] outputs: [stage3_unit6_relu3 -> (1, 256, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage3_unit6_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv3 [Conv] inputs: [stage3_unit6_relu3 -> (1, 256, 14, 14)], [stage3_unit6_conv3_weight -> (1024, 256, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 256, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage3_unit6_conv3 for ONNX node: stage3_unit6_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage3_unit6_conv3 for ONNX tensor: stage3_unit6_conv3
[05/21/2021-07:41:32] [V] [TRT] stage3_unit6_conv3 [Conv] outputs: [stage3_unit6_conv3 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus12 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage3_unit6_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus11
[05/21/2021-07:41:32] [V] [TRT] _plus12 [Add] inputs: [stage3_unit6_conv3 -> (1, 1024, 14, 14)], [_plus11 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus12 for ONNX node: _plus12
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus12 for ONNX tensor: _plus12
[05/21/2021-07:41:32] [V] [TRT] _plus12 [Add] outputs: [_plus12 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus12
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn1 [BatchNormalization] inputs: [_plus12 -> (1, 1024, 14, 14)], [stage4_unit1_bn1_gamma -> (1024)], [stage4_unit1_bn1_beta -> (1024)], [stage4_unit1_bn1_moving_mean -> (1024)], [stage4_unit1_bn1_moving_var -> (1024)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_bn1 for ONNX node: stage4_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_bn1 for ONNX tensor: stage4_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn1 [BatchNormalization] outputs: [stage4_unit1_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu1 [Relu] inputs: [stage4_unit1_bn1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_relu1 for ONNX node: stage4_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_relu1 for ONNX tensor: stage4_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu1 [Relu] outputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv1 [Conv] inputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], [stage4_unit1_conv1_weight -> (512, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_conv1 for ONNX node: stage4_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_conv1 for ONNX tensor: stage4_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv1 [Conv] outputs: [stage4_unit1_conv1 -> (1, 512, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn2 [BatchNormalization] inputs: [stage4_unit1_conv1 -> (1, 512, 14, 14)], [stage4_unit1_bn2_gamma -> (512)], [stage4_unit1_bn2_beta -> (512)], [stage4_unit1_bn2_moving_mean -> (512)], [stage4_unit1_bn2_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_bn2 for ONNX node: stage4_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_bn2 for ONNX tensor: stage4_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn2 [BatchNormalization] outputs: [stage4_unit1_bn2 -> (1, 512, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu2 [Relu] inputs: [stage4_unit1_bn2 -> (1, 512, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_relu2 for ONNX node: stage4_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_relu2 for ONNX tensor: stage4_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu2 [Relu] outputs: [stage4_unit1_relu2 -> (1, 512, 14, 14)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv2 [Conv] inputs: [stage4_unit1_relu2 -> (1, 512, 14, 14)], [stage4_unit1_conv2_weight -> (512, 512, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_conv2 for ONNX node: stage4_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_conv2 for ONNX tensor: stage4_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv2 [Conv] outputs: [stage4_unit1_conv2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn3 [BatchNormalization] inputs: [stage4_unit1_conv2 -> (1, 512, 7, 7)], [stage4_unit1_bn3_gamma -> (512)], [stage4_unit1_bn3_beta -> (512)], [stage4_unit1_bn3_moving_mean -> (512)], [stage4_unit1_bn3_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_bn3 for ONNX node: stage4_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_bn3 for ONNX tensor: stage4_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_bn3 [BatchNormalization] outputs: [stage4_unit1_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_bn3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu3 [Relu] inputs: [stage4_unit1_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_relu3 for ONNX node: stage4_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_relu3 for ONNX tensor: stage4_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_relu3 [Relu] outputs: [stage4_unit1_relu3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv3 [Conv] inputs: [stage4_unit1_relu3 -> (1, 512, 7, 7)], [stage4_unit1_conv3_weight -> (2048, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_conv3 for ONNX node: stage4_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_conv3 for ONNX tensor: stage4_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_conv3 [Conv] outputs: [stage4_unit1_conv3 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit1_sc [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_sc_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_sc [Conv] inputs: [stage4_unit1_relu1 -> (1, 1024, 14, 14)], [stage4_unit1_sc_weight -> (2048, 1024, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 1024, 14, 14)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit1_sc for ONNX node: stage4_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit1_sc for ONNX tensor: stage4_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] stage4_unit1_sc [Conv] outputs: [stage4_unit1_sc -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus13 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit1_sc
[05/21/2021-07:41:32] [V] [TRT] _plus13 [Add] inputs: [stage4_unit1_conv3 -> (1, 2048, 7, 7)], [stage4_unit1_sc -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus13 for ONNX node: _plus13
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus13 for ONNX tensor: _plus13
[05/21/2021-07:41:32] [V] [TRT] _plus13 [Add] outputs: [_plus13 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus13
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn1 [BatchNormalization] inputs: [_plus13 -> (1, 2048, 7, 7)], [stage4_unit2_bn1_gamma -> (2048)], [stage4_unit2_bn1_beta -> (2048)], [stage4_unit2_bn1_moving_mean -> (2048)], [stage4_unit2_bn1_moving_var -> (2048)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_bn1 for ONNX node: stage4_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_bn1 for ONNX tensor: stage4_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn1 [BatchNormalization] outputs: [stage4_unit2_bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu1 [Relu] inputs: [stage4_unit2_bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_relu1 for ONNX node: stage4_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_relu1 for ONNX tensor: stage4_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu1 [Relu] outputs: [stage4_unit2_relu1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv1 [Conv] inputs: [stage4_unit2_relu1 -> (1, 2048, 7, 7)], [stage4_unit2_conv1_weight -> (512, 2048, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_conv1 for ONNX node: stage4_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_conv1 for ONNX tensor: stage4_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv1 [Conv] outputs: [stage4_unit2_conv1 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_bn2 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn2_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn2_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn2_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn2_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn2 [BatchNormalization] inputs: [stage4_unit2_conv1 -> (1, 512, 7, 7)], [stage4_unit2_bn2_gamma -> (512)], [stage4_unit2_bn2_beta -> (512)], [stage4_unit2_bn2_moving_mean -> (512)], [stage4_unit2_bn2_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_bn2 for ONNX node: stage4_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_bn2 for ONNX tensor: stage4_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn2 [BatchNormalization] outputs: [stage4_unit2_bn2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_relu2 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu2 [Relu] inputs: [stage4_unit2_bn2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_relu2 for ONNX node: stage4_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_relu2 for ONNX tensor: stage4_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu2 [Relu] outputs: [stage4_unit2_relu2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_conv2 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_relu2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv2_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv2 [Conv] inputs: [stage4_unit2_relu2 -> (1, 512, 7, 7)], [stage4_unit2_conv2_weight -> (512, 512, 3, 3)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_conv2 for ONNX node: stage4_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_conv2 for ONNX tensor: stage4_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv2 [Conv] outputs: [stage4_unit2_conv2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_bn3 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv2
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn3_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn3_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn3_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn3_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn3 [BatchNormalization] inputs: [stage4_unit2_conv2 -> (1, 512, 7, 7)], [stage4_unit2_bn3_gamma -> (512)], [stage4_unit2_bn3_beta -> (512)], [stage4_unit2_bn3_moving_mean -> (512)], [stage4_unit2_bn3_moving_var -> (512)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_bn3 for ONNX node: stage4_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_bn3 for ONNX tensor: stage4_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_bn3 [BatchNormalization] outputs: [stage4_unit2_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_relu3 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_bn3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu3 [Relu] inputs: [stage4_unit2_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_relu3 for ONNX node: stage4_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_relu3 for ONNX tensor: stage4_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_relu3 [Relu] outputs: [stage4_unit2_relu3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit2_conv3 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_relu3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv3_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv3 [Conv] inputs: [stage4_unit2_relu3 -> (1, 512, 7, 7)], [stage4_unit2_conv3_weight -> (2048, 512, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit2_conv3 for ONNX node: stage4_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit2_conv3 for ONNX tensor: stage4_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] stage4_unit2_conv3 [Conv] outputs: [stage4_unit2_conv3 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: _plus14 [Add]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit2_conv3
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus13
[05/21/2021-07:41:32] [V] [TRT] _plus14 [Add] inputs: [stage4_unit2_conv3 -> (1, 2048, 7, 7)], [_plus13 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: _plus14 for ONNX node: _plus14
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: _plus14 for ONNX tensor: _plus14
[05/21/2021-07:41:32] [V] [TRT] _plus14 [Add] outputs: [_plus14 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit3_bn1 [BatchNormalization]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: _plus14
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_bn1_gamma
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_bn1_beta
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_bn1_moving_mean
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_bn1_moving_var
[05/21/2021-07:41:32] [V] [TRT] stage4_unit3_bn1 [BatchNormalization] inputs: [_plus14 -> (1, 2048, 7, 7)], [stage4_unit3_bn1_gamma -> (2048)], [stage4_unit3_bn1_beta -> (2048)], [stage4_unit3_bn1_moving_mean -> (2048)], [stage4_unit3_bn1_moving_var -> (2048)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit3_bn1 for ONNX node: stage4_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit3_bn1 for ONNX tensor: stage4_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit3_bn1 [BatchNormalization] outputs: [stage4_unit3_bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit3_relu1 [Relu]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_bn1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit3_relu1 [Relu] inputs: [stage4_unit3_bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit3_relu1 for ONNX node: stage4_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit3_relu1 for ONNX tensor: stage4_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] stage4_unit3_relu1 [Relu] outputs: [stage4_unit3_relu1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:32] [V] [TRT] Parsing node: stage4_unit3_conv1 [Conv]
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_relu1
[05/21/2021-07:41:32] [V] [TRT] Searching for input: stage4_unit3_conv1_weight
[05/21/2021-07:41:32] [V] [TRT] stage4_unit3_conv1 [Conv] inputs: [stage4_unit3_relu1 -> (1, 2048, 7, 7)], [stage4_unit3_conv1_weight -> (512, 2048, 1, 1)], 
[05/21/2021-07:41:32] [V] [TRT] Convolution input dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering layer: stage4_unit3_conv1 for ONNX node: stage4_unit3_conv1
[05/21/2021-07:41:32] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:32] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:32] [V] [TRT] Registering tensor: stage4_unit3_conv1 for ONNX tensor: stage4_unit3_conv1
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_conv1 [Conv] outputs: [stage4_unit3_conv1 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_bn2 [BatchNormalization]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_conv1
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn2_gamma
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn2_beta
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn2_moving_mean
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn2_moving_var
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_bn2 [BatchNormalization] inputs: [stage4_unit3_conv1 -> (1, 512, 7, 7)], [stage4_unit3_bn2_gamma -> (512)], [stage4_unit3_bn2_beta -> (512)], [stage4_unit3_bn2_moving_mean -> (512)], [stage4_unit3_bn2_moving_var -> (512)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_bn2 for ONNX node: stage4_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_bn2 for ONNX tensor: stage4_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_bn2 [BatchNormalization] outputs: [stage4_unit3_bn2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_relu2 [Relu]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_relu2 [Relu] inputs: [stage4_unit3_bn2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_relu2 for ONNX node: stage4_unit3_relu2
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_relu2 for ONNX tensor: stage4_unit3_relu2
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_relu2 [Relu] outputs: [stage4_unit3_relu2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_conv2 [Conv]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_relu2
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_conv2_weight
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_conv2 [Conv] inputs: [stage4_unit3_relu2 -> (1, 512, 7, 7)], [stage4_unit3_conv2_weight -> (512, 512, 3, 3)], 
[05/21/2021-07:41:33] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_conv2 for ONNX node: stage4_unit3_conv2
[05/21/2021-07:41:33] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[05/21/2021-07:41:33] [V] [TRT] Convolution output dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_conv2 for ONNX tensor: stage4_unit3_conv2
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_conv2 [Conv] outputs: [stage4_unit3_conv2 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_bn3 [BatchNormalization]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_conv2
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn3_gamma
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn3_beta
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn3_moving_mean
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn3_moving_var
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_bn3 [BatchNormalization] inputs: [stage4_unit3_conv2 -> (1, 512, 7, 7)], [stage4_unit3_bn3_gamma -> (512)], [stage4_unit3_bn3_beta -> (512)], [stage4_unit3_bn3_moving_mean -> (512)], [stage4_unit3_bn3_moving_var -> (512)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_bn3 for ONNX node: stage4_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_bn3 for ONNX tensor: stage4_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_bn3 [BatchNormalization] outputs: [stage4_unit3_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_relu3 [Relu]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_relu3 [Relu] inputs: [stage4_unit3_bn3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_relu3 for ONNX node: stage4_unit3_relu3
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_relu3 for ONNX tensor: stage4_unit3_relu3
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_relu3 [Relu] outputs: [stage4_unit3_relu3 -> (1, 512, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: stage4_unit3_conv3 [Conv]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_relu3
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_conv3_weight
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_conv3 [Conv] inputs: [stage4_unit3_relu3 -> (1, 512, 7, 7)], [stage4_unit3_conv3_weight -> (2048, 512, 1, 1)], 
[05/21/2021-07:41:33] [V] [TRT] Convolution input dimensions: (1, 512, 7, 7)
[05/21/2021-07:41:33] [V] [TRT] Registering layer: stage4_unit3_conv3 for ONNX node: stage4_unit3_conv3
[05/21/2021-07:41:33] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[05/21/2021-07:41:33] [V] [TRT] Convolution output dimensions: (1, 2048, 7, 7)
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: stage4_unit3_conv3 for ONNX tensor: stage4_unit3_conv3
[05/21/2021-07:41:33] [V] [TRT] stage4_unit3_conv3 [Conv] outputs: [stage4_unit3_conv3 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: _plus15 [Add]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: stage4_unit3_conv3
[05/21/2021-07:41:33] [V] [TRT] Searching for input: _plus14
[05/21/2021-07:41:33] [V] [TRT] _plus15 [Add] inputs: [stage4_unit3_conv3 -> (1, 2048, 7, 7)], [_plus14 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: _plus15 for ONNX node: _plus15
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: _plus15 for ONNX tensor: _plus15
[05/21/2021-07:41:33] [V] [TRT] _plus15 [Add] outputs: [_plus15 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: bn1 [BatchNormalization]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: _plus15
[05/21/2021-07:41:33] [V] [TRT] Searching for input: bn1_gamma
[05/21/2021-07:41:33] [V] [TRT] Searching for input: bn1_beta
[05/21/2021-07:41:33] [V] [TRT] Searching for input: bn1_moving_mean
[05/21/2021-07:41:33] [V] [TRT] Searching for input: bn1_moving_var
[05/21/2021-07:41:33] [V] [TRT] bn1 [BatchNormalization] inputs: [_plus15 -> (1, 2048, 7, 7)], [bn1_gamma -> (2048)], [bn1_beta -> (2048)], [bn1_moving_mean -> (2048)], [bn1_moving_var -> (2048)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: bn1 for ONNX node: bn1
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: bn1 for ONNX tensor: bn1
[05/21/2021-07:41:33] [V] [TRT] bn1 [BatchNormalization] outputs: [bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: relu1 [Relu]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: bn1
[05/21/2021-07:41:33] [V] [TRT] relu1 [Relu] inputs: [bn1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: relu1 for ONNX node: relu1
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: relu1 for ONNX tensor: relu1
[05/21/2021-07:41:33] [V] [TRT] relu1 [Relu] outputs: [relu1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: pool1 [GlobalAveragePool]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: relu1
[05/21/2021-07:41:33] [V] [TRT] pool1 [GlobalAveragePool] inputs: [relu1 -> (1, 2048, 7, 7)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: pool1 for ONNX node: pool1
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: pool1 for ONNX tensor: pool1
[05/21/2021-07:41:33] [V] [TRT] pool1 [GlobalAveragePool] outputs: [pool1 -> (1, 2048, 1, 1)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: flatten0 [Flatten]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: pool1
[05/21/2021-07:41:33] [V] [TRT] flatten0 [Flatten] inputs: [pool1 -> (1, 2048, 1, 1)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: flatten0 for ONNX node: flatten0
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: flatten0 for ONNX tensor: flatten0
[05/21/2021-07:41:33] [V] [TRT] flatten0 [Flatten] outputs: [flatten0 -> (1, 2048)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: flatten_434 [Flatten]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: flatten0
[05/21/2021-07:41:33] [V] [TRT] flatten_434 [Flatten] inputs: [flatten0 -> (1, 2048)], 
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: flatten_434 for ONNX tensor: flatten_434
[05/21/2021-07:41:33] [V] [TRT] flatten_434 [Flatten] outputs: [flatten_434 -> (1, 2048)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: fc1 [Gemm]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: flatten_434
[05/21/2021-07:41:33] [V] [TRT] Searching for input: fc1_weight
[05/21/2021-07:41:33] [V] [TRT] Searching for input: fc1_bias
[05/21/2021-07:41:33] [V] [TRT] fc1 [Gemm] inputs: [flatten_434 -> (1, 2048)], [fc1_weight -> (1000, 2048)], [fc1_bias -> (1000)], 
[05/21/2021-07:41:33] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met.
[05/21/2021-07:41:33] [V] [TRT] Original shape: (1, 2048), unsqueezing to: (1, 2048, 1, 1)
[05/21/2021-07:41:33] [V] [TRT] Registering layer: fc1 for ONNX node: fc1
[05/21/2021-07:41:33] [V] [TRT] Original shape: (1, 1000, 1, 1), squeezing to: (1, 1000)
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: fc1 for ONNX tensor: fc1
[05/21/2021-07:41:33] [V] [TRT] fc1 [Gemm] outputs: [fc1 -> (1, 1000)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: cast1 [Cast]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: fc1
[05/21/2021-07:41:33] [V] [TRT] cast1 [Cast] inputs: [fc1 -> (1, 1000)], 
[05/21/2021-07:41:33] [V] [TRT] Casting to type: float32
[05/21/2021-07:41:33] [W] [TRT] Tensor DataType is determined at build time for tensors not marked as input or output.
[05/21/2021-07:41:33] [V] [TRT] Registering layer: cast1 for ONNX node: cast1
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: cast1 for ONNX tensor: cast1
[05/21/2021-07:41:33] [V] [TRT] cast1 [Cast] outputs: [cast1 -> (1, 1000)], 
[05/21/2021-07:41:33] [V] [TRT] Parsing node: softmax [Softmax]
[05/21/2021-07:41:33] [V] [TRT] Searching for input: cast1
[05/21/2021-07:41:33] [V] [TRT] softmax [Softmax] inputs: [cast1 -> (1, 1000)], 
[05/21/2021-07:41:33] [V] [TRT] Registering layer: softmax for ONNX node: softmax
[05/21/2021-07:41:33] [V] [TRT] Registering tensor: softmax_259 for ONNX tensor: softmax
[05/21/2021-07:41:33] [V] [TRT] softmax [Softmax] outputs: [softmax -> (1, 1000)], 
[05/21/2021-07:41:33] [V] [TRT] Marking softmax_259 as output: softmax
[05/21/2021-07:41:33] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 544, GPU 10788 (MiB)
[05/21/2021-07:41:33] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 641 MiB, GPU 10788 MiB
[05/21/2021-07:41:33] [V] [TRT] Applying generic optimizations to the graph for inference.
[05/21/2021-07:41:33] [V] [TRT] Original: 181 layers
[05/21/2021-07:41:33] [V] [TRT] After dead-layer removal: 181 layers
[05/21/2021-07:41:33] [V] [TRT] ShuffleShuffleFusion: Fusing flatten0 with (Unnamed Layer* 174) [Shuffle]
[05/21/2021-07:41:33] [V] [TRT] Removing flatten0 + (Unnamed Layer* 174) [Shuffle]
[05/21/2021-07:41:33] [V] [TRT] Removing (Unnamed Layer* 178) [Shuffle]
[05/21/2021-07:41:33] [V] [TRT] Removing (Unnamed Layer* 180) [Shuffle]
[05/21/2021-07:41:33] [V] [TRT] After Myelin optimization: 177 layers
[05/21/2021-07:41:33] [V] [TRT] Convert layer type of fc1 from FULLY_CONNECTED to CONVOLUTION
[05/21/2021-07:41:33] [V] [TRT] Removing shuffle_between_pool1_and_fc1
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from conv0 with scale bn0
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit1_conv1 with scale stage1_unit1_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit1_conv2 with scale stage1_unit1_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit2_conv1 with scale stage1_unit2_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit2_conv2 with scale stage1_unit2_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit3_conv1 with scale stage1_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage1_unit3_conv2 with scale stage1_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit1_conv1 with scale stage2_unit1_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit1_conv2 with scale stage2_unit1_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit2_conv1 with scale stage2_unit2_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit2_conv2 with scale stage2_unit2_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit3_conv1 with scale stage2_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit3_conv2 with scale stage2_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit4_conv1 with scale stage2_unit4_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage2_unit4_conv2 with scale stage2_unit4_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit1_conv1 with scale stage3_unit1_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit1_conv2 with scale stage3_unit1_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit2_conv1 with scale stage3_unit2_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit2_conv2 with scale stage3_unit2_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit3_conv1 with scale stage3_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit3_conv2 with scale stage3_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit4_conv1 with scale stage3_unit4_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit4_conv2 with scale stage3_unit4_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit5_conv1 with scale stage3_unit5_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit5_conv2 with scale stage3_unit5_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit6_conv1 with scale stage3_unit6_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage3_unit6_conv2 with scale stage3_unit6_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit1_conv1 with scale stage4_unit1_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit1_conv2 with scale stage4_unit1_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit2_conv1 with scale stage4_unit2_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit2_conv2 with scale stage4_unit2_bn3
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit3_conv1 with scale stage4_unit3_bn2
[05/21/2021-07:41:33] [V] [TRT] Fusing convolution weights from stage4_unit3_conv2 with scale stage4_unit3_bn3
[05/21/2021-07:41:33] [V] [TRT] After scale fusion: 144 layers
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing conv0 with relu0
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit1_bn1 with stage1_unit1_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit1_sc with _plus0
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit1_conv1 with stage1_unit1_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit1_conv2 with stage1_unit1_relu3
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit2_bn1 with stage1_unit2_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit2_conv1 with stage1_unit2_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit2_conv2 with stage1_unit2_relu3
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit2_conv3 with _plus1
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage1_unit3_bn1 with stage1_unit3_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit3_conv1 with stage1_unit3_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage1_unit3_conv2 with stage1_unit3_relu3
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage1_unit3_conv3 with _plus2
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit1_bn1 with stage2_unit1_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit1_sc with _plus3
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit1_conv1 with stage2_unit1_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit1_conv2 with stage2_unit1_relu3
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit2_bn1 with stage2_unit2_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit2_conv1 with stage2_unit2_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit2_conv2 with stage2_unit2_relu3
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit2_conv3 with _plus4
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit3_bn1 with stage2_unit3_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit3_conv1 with stage2_unit3_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit3_conv2 with stage2_unit3_relu3
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit3_conv3 with _plus5
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage2_unit4_bn1 with stage2_unit4_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit4_conv1 with stage2_unit4_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage2_unit4_conv2 with stage2_unit4_relu3
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage2_unit4_conv3 with _plus6
[05/21/2021-07:41:33] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit1_bn1 with stage3_unit1_relu1
[05/21/2021-07:41:33] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit1_sc with _plus7
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage3_unit1_conv1 with stage3_unit1_relu2
[05/21/2021-07:41:33] [V] [TRT] ConvReluFusion: Fusing stage3_unit1_conv2 with stage3_unit1_relu3
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit2_bn1 with stage3_unit2_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit2_conv1 with stage3_unit2_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit2_conv2 with stage3_unit2_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit2_conv3 with _plus8
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit3_bn1 with stage3_unit3_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit3_conv1 with stage3_unit3_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit3_conv2 with stage3_unit3_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit3_conv3 with _plus9
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit4_bn1 with stage3_unit4_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit4_conv1 with stage3_unit4_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit4_conv2 with stage3_unit4_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit4_conv3 with _plus10
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit5_bn1 with stage3_unit5_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit5_conv1 with stage3_unit5_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit5_conv2 with stage3_unit5_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit5_conv3 with _plus11
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage3_unit6_bn1 with stage3_unit6_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit6_conv1 with stage3_unit6_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage3_unit6_conv2 with stage3_unit6_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage3_unit6_conv3 with _plus12
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit1_bn1 with stage4_unit1_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit1_sc with _plus13
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit1_conv1 with stage4_unit1_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit1_conv2 with stage4_unit1_relu3
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit2_bn1 with stage4_unit2_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit2_conv1 with stage4_unit2_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit2_conv2 with stage4_unit2_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit2_conv3 with _plus14
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing stage4_unit3_bn1 with stage4_unit3_relu1
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit3_conv1 with stage4_unit3_relu2
[05/21/2021-07:41:34] [V] [TRT] ConvReluFusion: Fusing stage4_unit3_conv2 with stage4_unit3_relu3
[05/21/2021-07:41:34] [V] [TRT] ConvEltwiseSumFusion: Fusing stage4_unit3_conv3 with _plus15
[05/21/2021-07:41:34] [V] [TRT] ScaleActivationFusion: Fusing bn1 with relu1
[05/21/2021-07:41:34] [V] [TRT] Swap the layer type of pool1 from REDUCE to POOLING
[05/21/2021-07:41:34] [W] [TRT] Convolution + generic activation fusion is disable due to incompatible driver or nvrtc
[05/21/2021-07:41:34] [V] [TRT] After vertical fusions: 78 layers
[05/21/2021-07:41:34] [V] [TRT] After dupe layer removal: 78 layers
[05/21/2021-07:41:34] [V] [TRT] After final dead-layer removal: 78 layers
[05/21/2021-07:41:34] [V] [TRT] After tensor merging: 78 layers
[05/21/2021-07:41:34] [V] [TRT] After concat removal: 78 layers
[05/21/2021-07:41:34] [V] [TRT] Graph construction and optimization completed in 1.00725 seconds.
[05/21/2021-07:41:34] [V] [TRT] Using cublasLt a tactic source
[05/21/2021-07:41:34] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +654, GPU +272, now: CPU 1355, GPU 11060 (MiB)
[05/21/2021-07:41:34] [V] [TRT] Using cuDNN as a tactic source
[05/21/2021-07:41:35] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +635, GPU +260, now: CPU 1990, GPU 11320 (MiB)
[05/21/2021-07:41:35] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4
[05/21/2021-07:41:35] [W] [TRT] Detected invalid timing cache, setup a local cache instead
[05/21/2021-07:41:35] [V] [TRT] Constructing optimization profile number 0 [1/1].
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.034876
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.005144
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005144
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.016356
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.005508
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005508
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Float(50176,50176:32,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.02984
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.060104
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.02984
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.0075
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.00732
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.004244
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004244
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.016896
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.00862
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00862
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.006536
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.007976
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.004544
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004544
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.004728
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004728
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.017024
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.008624
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.008624
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.017592
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.017408
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.006136
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006136
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.01744
[05/21/2021-07:41:35] [V] [TRT] Tactic: 0 Time: 0.008184
[05/21/2021-07:41:35] [V] [TRT] Fastest Tactic: 0 Time: 0.008184
[05/21/2021-07:41:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:35] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:35] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:35] [V] [TRT] Tactic: 1002 Time: 0.016476
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.005508
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005508
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.008104
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.005524
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005524
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.017812
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006736
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006736
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018196
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.009148
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.009148
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018696
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006696
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006696
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.008704
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006908
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006908
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018432
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.008064
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.008064
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Float(50176,50176:32,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018452
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.009856
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.007936
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.0032
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0032
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.009984
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.007176
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004404
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004404
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.009888
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.00896
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00896
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.03712
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.022272
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.00528
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00528
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018432
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.01856
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.00896
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00896
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.035968
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004212
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004212
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.021632
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.004088
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004088
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.0179
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006128
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006128
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.018692
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.009216
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.009216
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.036268
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006428
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006428
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:36] [V] [TRT] Tactic: 1002 Time: 0.022436
[05/21/2021-07:41:36] [V] [TRT] Tactic: 0 Time: 0.006276
[05/21/2021-07:41:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006276
[05/21/2021-07:41:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:36] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:36] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.018224
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.006512
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006512
[05/21/2021-07:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: cast0 (Cast)
[05/21/2021-07:41:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: cast0 (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.01858
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.009024
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.009024
[05/21/2021-07:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.030848
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.00514
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00514
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.019584
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.005236
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005236
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.017364
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.00716
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.005788
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005788
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.018176
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.006272
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006272
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.018324
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.008184
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.008184
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.030604
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.005136
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005136
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.022528
[05/21/2021-07:41:37] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:41:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:41:37] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:37] [V] [TRT] Tactic: 1002 Time: 0.016544
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.008144
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005296
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005296
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.018176
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00658
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00658
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.0181
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.008968
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.008968
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.007568
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004908
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004908
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.019616
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.01664
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.01024
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004564
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004564
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.007984
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.009348
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.008832
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.008832
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.0174
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00406
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00406
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.007344
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.007112
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005176
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005176
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.036864
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004068
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004068
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.019232
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.018448
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00896
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00896
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.017892
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.020688
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.017792
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005636
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005636
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.035968
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.022656
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004192
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004192
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.01832
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.008832
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.008832
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.017564
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.006092
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006092
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.02048
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.0046
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0046
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.017816
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005268
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005268
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.035312
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.0067
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0067
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.022912
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.006572
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006572
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.018444
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.006784
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.006784
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Float(150528,50176,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:41:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Float(150528,1,672,3) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Float(50176,1:4,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(150528,50176,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.004496
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004496
[05/21/2021-07:41:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(100352,50176:2,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:41:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(50176,1:8,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:41:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:38] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,224,1) ***************
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: bn_data (Scale)
[05/21/2021-07:41:38] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,50176,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.006296
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.0046
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.0046
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(150528,1,672,3) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.006228
[05/21/2021-07:41:38] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:41:38] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:41:38] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:38] [V] [TRT] Tactic: 1002 Time: 0.006224
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005924
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005924
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(150528,50176,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.008704
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.00464
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00464
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,50176:2,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.01792
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.017608
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005252
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005252
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(150528,1,672,3) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.008068
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Float(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.006008
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.006008
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(150528,50176,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.036864
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.004896
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.004896
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(100352,50176:2,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.022144
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005236
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005236
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(50176,1:8,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.018432
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.006656
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.006656
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:4,224,1) -> Half(50176,1:16,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.018464
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.00822
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00822
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.017524
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.005124
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005124
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,224,1) -> Half(50176,1:4,224,1) (Reformat)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1002 Time: 0.017692
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:41:39] [V] [TRT] *************** Autotuning format combination: Float(150528,50176,224,1) -> Float(802816,12544,112,1) ***************
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudaDepthwiseConvolution)
[05/21/2021-07:41:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (FusedConvActConvolution)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 131071 Time: 0.036096
[05/21/2021-07:41:39] [V] [TRT] Tactic: 3276799 Time: 0.038912
[05/21/2021-07:41:39] [V] [TRT] Tactic: 8454143 Time: 0.038792
[05/21/2021-07:41:39] [V] [TRT] Fastest Tactic: 131071 Time: 0.036096
[05/21/2021-07:41:39] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:39] [V] [TRT] Tactic: 0 Time: 0.049536
[05/21/2021-07:41:39] [V] [TRT] Tactic: 1 Time: 0.047068
[05/21/2021-07:41:39] [V] [TRT] Tactic: 2 Time: 0.057992
[05/21/2021-07:41:40] [V] [TRT] Tactic: 5 Time: 1.02214
[05/21/2021-07:41:40] [V] [TRT] Tactic: 56 Time: 0.05184
[05/21/2021-07:41:40] [V] [TRT] Tactic: 57 Time: 0.047232
[05/21/2021-07:41:40] [V] [TRT] Tactic: 58 Time: 0.058496
[05/21/2021-07:41:40] [V] [TRT] Tactic: 61 Time: 1.02162
[05/21/2021-07:41:40] [V] [TRT] Tactic: 112 Time: 0.051988
[05/21/2021-07:41:40] [V] [TRT] Tactic: 113 Time: 0.04754
[05/21/2021-07:41:40] [V] [TRT] Tactic: 114 Time: 0.058116
[05/21/2021-07:41:40] [V] [TRT] Tactic: 117 Time: 1.02418
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: 1 Time: 0.047068
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:41:40] [V] [TRT] Tactic: 6053873026024413720 Time: 0.047744
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:41:40] [V] [TRT] Tactic: 6767548733843469815 Time: 0.026844
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:41:40] [V] [TRT] Tactic: -1123676555321336786 Time: 0.043312
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:41:40] [V] [TRT] Tactic: -701551393537224327 Time: 0.028696
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: 6767548733843469815 Time: 0.026844
[05/21/2021-07:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6767548733843469815
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Float(150528,1,672,3) -> Float(802816,1,7168,64) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:41:40] [V] [TRT] Tactic: -3855385237722507464 Time: 0.095112
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:41:40] [V] [TRT] Tactic: -2809379259463049391 Time: 0.094848
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: -2809379259463049391 Time: 0.094848
[05/21/2021-07:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2809379259463049391
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,224,1) -> Float(200704,1:4,1792,16) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:41:40] [V] [TRT] Tactic: 4474630279712975759 Time: 0.160728
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:41:40] [V] [TRT] Tactic: 4696204239951173149 Time: 0.10368
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:41:40] [V] [TRT] Tactic: 7155825427510256858 Time: 0.091468
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:41:40] [V] [TRT] Tactic: 7342025736444949634 Time: 0.126336
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:41:40] [V] [TRT] Tactic: 8918020581761223752 Time: 0.090796
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:41:40] [V] [TRT] Tactic: -4756382386362004279 Time: 0.10148
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:41:40] [V] [TRT] Tactic: -3855385237722507464 Time: 0.0936
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:41:40] [V] [TRT] Tactic: -2809379259463049391 Time: 0.093184
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: 8918020581761223752 Time: 0.090796
[05/21/2021-07:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8918020581761223752
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Half(150528,50176,224,1) -> Half(802816,12544,112,1) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] Tactic: 0 Time: 0.03776
[05/21/2021-07:41:40] [V] [TRT] Tactic: 1 Time: 0.037412
[05/21/2021-07:41:40] [V] [TRT] Tactic: 2 Time: 0.053484
[05/21/2021-07:41:40] [V] [TRT] Tactic: 5 Time: 1.03777
[05/21/2021-07:41:40] [V] [TRT] Tactic: 56 Time: 0.039116
[05/21/2021-07:41:40] [V] [TRT] Tactic: 58 Time: 0.054404
[05/21/2021-07:41:40] [V] [TRT] Tactic: 61 Time: 1.03716
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: 1 Time: 0.037412
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Half(100352,50176:2,224,1) -> Half(401408,12544:2,112,1) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (FusedConvActConvolution)
[05/21/2021-07:41:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:41:40] [V] [TRT] Tactic: 2195670545862694453 Time: 0.02422
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:41:40] [V] [TRT] Tactic: 3419182076704469245 Time: 0.023916
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:41:40] [V] [TRT] Tactic: 3891805945559659536 Time: 0.039944
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:41:40] [V] [TRT] Tactic: 5548126322150286555 Time: 0.023808
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:41:40] [V] [TRT] Tactic: -7928611605886347652 Time: 0.039936
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:41:40] [V] [TRT] Tactic: -5172391392092686714 Time: 0.023672
[05/21/2021-07:41:40] [V] [TRT] Fastest Tactic: -5172391392092686714 Time: 0.023672
[05/21/2021-07:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5172391392092686714
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Half(50176,1:4,224,1) -> Half(100352,1:8,896,8) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Float(802816,12544,112,1) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,224,1) -> Half(100352,1:8,896,8) ***************
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudaDepthwiseConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:40] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:41:40] [V] [TRT] Tactic: 254850674756030979 Time: 0.135948
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:41:40] [V] [TRT] Tactic: 1011057357468998345 Time: 0.06928
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:41:40] [V] [TRT] Tactic: 1156328698016730421 Time: 0.12224
[05/21/2021-07:41:40] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:41:41] [V] [TRT] Tactic: 1832046141070096030 Time: 0.093572
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:41:41] [V] [TRT] Tactic: 2428167804343994714 Time: 0.070576
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:41:41] [V] [TRT] Tactic: 2541579301352125276 Time: 0.14914
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:41:41] [V] [TRT] Tactic: 2819719497590964443 Time: 0.118796
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:41:41] [V] [TRT] Tactic: 2968605903460894194 Time: 0.084136
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:41:41] [V] [TRT] Tactic: 2986078304285316765 Time: 0.151356
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:41:41] [V] [TRT] Tactic: 3362537467505018070 Time: 0.118784
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:41:41] [V] [TRT] Tactic: 3513075359009385578 Time: 0.117908
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:41:41] [V] [TRT] Tactic: 3573559043797674382 Time: 0.09216
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:41:41] [V] [TRT] Tactic: 5368829646735632944 Time: 0.06826
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:41:41] [V] [TRT] Tactic: 5746691132547383910 Time: 0.118316
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:41:41] [V] [TRT] Tactic: 5770170567977052602 Time: 0.09332
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:41:41] [V] [TRT] Tactic: 6074229447555668232 Time: 0.09072
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:41:41] [V] [TRT] Tactic: 6446388116965632819 Time: 0.091564
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:41:41] [V] [TRT] Tactic: 6468794451065529747 Time: 0.085376
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:41:41] [V] [TRT] Tactic: 6642277870194067185 Time: 0.120836
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:41:41] [V] [TRT] Tactic: 6859477213531075460 Time: 0.090272
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:41:41] [V] [TRT] Tactic: 7216571380637776659 Time: 0.043564
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:41:41] [V] [TRT] Tactic: 7609923741161019135 Time: 0.091512
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:41:41] [V] [TRT] Tactic: 7705739241028240201 Time: 0.09128
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:41:41] [V] [TRT] Tactic: 8072087735545283117 Time: 0.11776
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:41:41] [V] [TRT] Tactic: 8101703987960976805 Time: 0.087216
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:41:41] [V] [TRT] Tactic: -9217371357561775773 Time: 0.087028
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:41:41] [V] [TRT] Tactic: -9009272790678027912 Time: 0.09322
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:41:41] [V] [TRT] Tactic: -8949544755481315679 Time: 0.087216
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:41:41] [V] [TRT] Tactic: -8759929675070720385 Time: 0.118896
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:41:41] [V] [TRT] Tactic: -8604374562669615024 Time: 0.091952
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:41:41] [V] [TRT] Tactic: -6840588038605932325 Time: 0.129024
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:41:41] [V] [TRT] Tactic: -6525498856028268801 Time: 0.034848
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:41:41] [V] [TRT] Tactic: -6356316196810535311 Time: 0.089084
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:41:41] [V] [TRT] Tactic: -6257787336162086472 Time: 0.121768
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:41:41] [V] [TRT] Tactic: -5777580938094193096 Time: 0.058912
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:41:41] [V] [TRT] Tactic: -5657273398217409378 Time: 0.062504
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:41:41] [V] [TRT] Tactic: -5161596964442251102 Time: 0.116608
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:41:41] [V] [TRT] Tactic: -5127240325355316006 Time: 0.126772
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:41:41] [V] [TRT] Tactic: -4706569565442112734 Time: 0.088448
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:41:41] [V] [TRT] Tactic: -4409144516525410768 Time: 0.118952
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:41:41] [V] [TRT] Tactic: -4021926646879732549 Time: 0.130184
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:41:41] [V] [TRT] Tactic: -3987638434926559037 Time: 0.118656
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:41:41] [V] [TRT] Tactic: -3905653247016903130 Time: 0.066948
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:41:41] [V] [TRT] Tactic: -3903974568488493144 Time: 0.043648
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:41:41] [V] [TRT] Tactic: -3895429239811098010 Time: 0.126976
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:41:41] [V] [TRT] Tactic: -3412636942650049698 Time: 0.067636
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:41:41] [V] [TRT] Tactic: -2816084650627734155 Time: 0.093824
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:41:41] [V] [TRT] Tactic: -2559894581585337900 Time: 0.135104
[05/21/2021-07:41:41] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:41:42] [V] [TRT] Tactic: -2530740716768816092 Time: 0.061696
[05/21/2021-07:41:42] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:41:42] [V] [TRT] Tactic: -2241736083352441442 Time: 0.042928
[05/21/2021-07:41:42] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:41:42] [V] [TRT] Tactic: -2161909437867201546 Time: 0.085632
[05/21/2021-07:41:42] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:41:42] [V] [TRT] Tactic: -1985778916402815946 Time: 0.09088
[05/21/2021-07:41:42] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:41:42] [V] [TRT] Tactic: -1500496213132463076 Time: 0.087544
[05/21/2021-07:41:42] [V] [TRT] conv0 + relu0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:41:42] [V] [TRT] Tactic: -606726295133751039 Time: 0.05184
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: -6525498856028268801 Time: 0.034848
[05/21/2021-07:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6525498856028268801
[05/21/2021-07:41:42] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,224,1) -> Half(50176,1:16,448,4) ***************
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CudnnConvolution)
[05/21/2021-07:41:42] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: conv0 + relu0 (CaskConvolution)
[05/21/2021-07:41:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.014848
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.013312
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.013312
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.014496
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.009856
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,12544,112,1) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.012548
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.01102
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.01102
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.018696
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.01504
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.01504
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.013952
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.014908
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.013952
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.014232
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.015104
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.014232
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,7168,64) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.01216
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.0113
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0113
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.018724
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.015376
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 0 Time: 0.015376
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.01536
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.01408
[05/21/2021-07:41:42] [V] [TRT] Tactic: 0 Time: 0.016044
[05/21/2021-07:41:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.01408
[05/21/2021-07:41:42] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,1792,16) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:42] [V] [TRT] Tactic: 1002 Time: 0.009984
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.012444
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.009984
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.015368
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.011264
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.011264
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.013696
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.00768
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00768
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,12544,112,1) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.011412
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.007936
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007936
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.016768
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.008744
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.008744
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.023808
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.007168
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,12544:2,112,1) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.011268
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.006
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.013312
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.006228
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006228
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.019328
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.006304
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006304
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,896,8) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.013044
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Float(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.014364
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.014208
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.014208
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(802816,12544,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.020136
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.01408
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 0 Time: 0.01408
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(401408,12544:2,112,1) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.013056
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.014224
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.013056
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,448,4) -> Half(100352,1:8,896,8) (Reformat)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 1002 Time: 0.010368
[05/21/2021-07:41:43] [V] [TRT] Tactic: 0 Time: 0.011348
[05/21/2021-07:41:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.010368
[05/21/2021-07:41:43] [V] [TRT] *************** Autotuning format combination: Float(802816,12544,112,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:41:43] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling)
[05/21/2021-07:41:43] [V] [TRT] Tactic: 257 Time: 0.010912
[05/21/2021-07:41:43] [V] [TRT] Tactic: 65793 Time: 0.010276
[05/21/2021-07:41:43] [V] [TRT] Tactic: 131329 Time: 0.012824
[05/21/2021-07:41:43] [V] [TRT] Tactic: 196865 Time: 0.013184
[05/21/2021-07:41:43] [V] [TRT] Tactic: 262401 Time: 0.014664
[05/21/2021-07:41:43] [V] [TRT] Tactic: 327937 Time: 0.013012
[05/21/2021-07:41:43] [V] [TRT] Tactic: 393473 Time: 0.015116
[05/21/2021-07:41:43] [V] [TRT] Tactic: 459009 Time: 0.009088
[05/21/2021-07:41:43] [V] [TRT] Tactic: 524545 Time: 0.007572
[05/21/2021-07:41:43] [V] [TRT] Tactic: 590081 Time: 0.009856
[05/21/2021-07:41:43] [V] [TRT] Tactic: 655617 Time: 0.009216
[05/21/2021-07:41:43] [V] [TRT] Tactic: 721153 Time: 0.011136
[05/21/2021-07:41:44] [V] [TRT] Tactic: 786689 Time: 0.009864
[05/21/2021-07:41:44] [V] [TRT] Tactic: 852225 Time: 0.011172
[05/21/2021-07:41:44] [V] [TRT] Tactic: 917761 Time: 0.008704
[05/21/2021-07:41:44] [V] [TRT] Tactic: 983297 Time: 0.00768
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1048833 Time: 0.008484
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1114369 Time: 0.011392
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1179905 Time: 0.010112
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1245441 Time: 0.009124
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1310977 Time: 0.010248
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1376513 Time: 0.008192
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1442049 Time: 0.006528
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1507585 Time: 0.008972
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1573121 Time: 0.010672
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1638657 Time: 0.010188
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1704193 Time: 0.008768
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1769729 Time: 0.009856
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1835265 Time: 0.006784
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1900801 Time: 0.006144
[05/21/2021-07:41:44] [V] [TRT] Tactic: 1966337 Time: 0.010444
[05/21/2021-07:41:44] [V] [TRT] Tactic: 2031873 Time: 0.010444
[05/21/2021-07:41:44] [V] [TRT] Tactic: 2097409 Time: 0.010112
[05/21/2021-07:41:44] [V] [TRT] Tactic: 2162945 Time: 0.008532
[05/21/2021-07:41:44] [V] [TRT] Tactic: 2228481 Time: 0.009344
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2294017 Time: 0.006656
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2359553 Time: 0.006188
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2425089 Time: 0.009984
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2490625 Time: 0.010136
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2556161 Time: 0.009984
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2621697 Time: 0.008332
[05/21/2021-07:41:45] [V] [TRT] Tactic: 2687233 Time: 0.007808
[05/21/2021-07:41:45] [V] [TRT] Tactic: 6947073 Time: 0.006528
[05/21/2021-07:41:45] [V] [TRT] Fastest Tactic: 1900801 Time: 0.006144
[05/21/2021-07:41:45] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling)
[05/21/2021-07:41:45] [V] [TRT] Tactic: -1 Time: 0.009476
[05/21/2021-07:41:45] [V] [TRT] Fastest Tactic: -1 Time: 0.009476
[05/21/2021-07:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 1900801
[05/21/2021-07:41:45] [V] [TRT] *************** Autotuning format combination: Half(802816,12544,112,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:41:45] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling)
[05/21/2021-07:41:45] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[05/21/2021-07:41:45] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling)
[05/21/2021-07:41:45] [V] [TRT] Tactic: -1 Time: 0.007228
[05/21/2021-07:41:45] [V] [TRT] Fastest Tactic: -1 Time: 0.007228
[05/21/2021-07:41:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1
[05/21/2021-07:41:45] [V] [TRT] *************** Autotuning format combination: Half(401408,12544:2,112,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:41:45] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling)
[05/21/2021-07:41:45] [V] [TRT] Tactic: 257 Time: 0.006656
[05/21/2021-07:41:45] [V] [TRT] Tactic: 65793 Time: 0.006272
[05/21/2021-07:41:45] [V] [TRT] Tactic: 131329 Time: 0.00858
[05/21/2021-07:41:45] [V] [TRT] Tactic: 196865 Time: 0.00896
[05/21/2021-07:41:45] [V] [TRT] Tactic: 262401 Time: 0.00758
[05/21/2021-07:41:45] [V] [TRT] Tactic: 327937 Time: 0.007936
[05/21/2021-07:41:45] [V] [TRT] Tactic: 393473 Time: 0.00832
[05/21/2021-07:41:45] [V] [TRT] Tactic: 459009 Time: 0.005632
[05/21/2021-07:41:45] [V] [TRT] Tactic: 524545 Time: 0.00512
[05/21/2021-07:41:45] [V] [TRT] Tactic: 590081 Time: 0.006928
[05/21/2021-07:41:45] [V] [TRT] Tactic: 655617 Time: 0.006656
[05/21/2021-07:41:45] [V] [TRT] Tactic: 721153 Time: 0.006144
[05/21/2021-07:41:45] [V] [TRT] Tactic: 786689 Time: 0.006144
[05/21/2021-07:41:46] [V] [TRT] Tactic: 852225 Time: 0.006892
[05/21/2021-07:41:46] [V] [TRT] Tactic: 917761 Time: 0.005632
[05/21/2021-07:41:46] [V] [TRT] Tactic: 983297 Time: 0.005392
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1048833 Time: 0.006784
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1114369 Time: 0.0064
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1179905 Time: 0.005248
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1245441 Time: 0.005632
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1310977 Time: 0.00654
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1376513 Time: 0.005792
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1442049 Time: 0.005152
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1507585 Time: 0.006272
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1573121 Time: 0.006528
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1638657 Time: 0.006428
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1704193 Time: 0.005888
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1769729 Time: 0.006016
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1835265 Time: 0.005248
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1900801 Time: 0.005248
[05/21/2021-07:41:46] [V] [TRT] Tactic: 1966337 Time: 0.007424
[05/21/2021-07:41:46] [V] [TRT] Tactic: 2031873 Time: 0.007552
[05/21/2021-07:41:46] [V] [TRT] Tactic: 2097409 Time: 0.006528
[05/21/2021-07:41:46] [V] [TRT] Tactic: 2162945 Time: 0.00576
[05/21/2021-07:41:46] [V] [TRT] Tactic: 2228481 Time: 0.006296
[05/21/2021-07:41:46] [V] [TRT] Tactic: 2294017 Time: 0.005376
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2359553 Time: 0.005504
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2425089 Time: 0.006784
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2490625 Time: 0.006312
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2556161 Time: 0.00634
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2621697 Time: 0.006276
[05/21/2021-07:41:47] [V] [TRT] Tactic: 2687233 Time: 0.006292
[05/21/2021-07:41:47] [V] [TRT] Tactic: 6947073 Time: 0.00512
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: 524545 Time: 0.00512
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: pooling0 (CudaPooling)
[05/21/2021-07:41:47] [V] [TRT] Tactic: -3 Time: 0.004856
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: -3 Time: 0.004856
[05/21/2021-07:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -3
[05/21/2021-07:41:47] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,896,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: pooling0 (TiledPooling)
[05/21/2021-07:41:47] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: pooling0 (CudaPooling)
[05/21/2021-07:41:47] [V] [TRT] Tactic: -2 Time: 0.00508
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: -2 Time: 0.00508
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: pooling0 (CudnnPooling)
[05/21/2021-07:41:47] [V] [TRT] Tactic: -1 Time: 0.00588
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: -1 Time: 0.00588
[05/21/2021-07:41:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -2
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:47] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:41:47] [V] [TRT] Tactic: 0 Time: 0.00618
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00618
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:47] [V] [TRT] Tactic: 1002 Time: 0.010712
[05/21/2021-07:41:47] [V] [TRT] Tactic: 0 Time: 0.006912
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006912
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:47] [V] [TRT] Tactic: 1002 Time: 0.007564
[05/21/2021-07:41:47] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:47] [V] [TRT] Tactic: 1002 Time: 0.008612
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.006304
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004092
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004092
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006036
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006036
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.011392
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.007088
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007088
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.009728
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007964
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.007192
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007192
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007724
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.006784
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005576
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005576
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005828
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005828
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006264
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006264
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006292
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006292
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006412
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006412
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006556
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005968
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005968
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007568
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005908
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005908
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.00746
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.01016
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004648
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004648
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.00832
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005508
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005508
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004212
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004212
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007204
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.008216
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.012032
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.007604
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.004124
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004124
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.00764
[05/21/2021-07:41:48] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:48] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005928
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005928
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006968
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.009268
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005664
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005664
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007936
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.007068
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007068
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006784
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.0058
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0058
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006732
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.010164
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.006568
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006568
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007592
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.006792
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006792
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005292
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005292
[05/21/2021-07:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004216
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004216
[05/21/2021-07:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004596
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004596
[05/21/2021-07:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:41:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:41:49] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: stage1_unit1_bn1 + stage1_unit1_relu1 (Scale)
[05/21/2021-07:41:49] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.010848
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.006272
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006272
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.01076
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005764
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005764
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.008196
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004616
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004616
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007288
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.011304
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00708
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00708
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.009744
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007844
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00706
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00706
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007804
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.007204
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007204
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005192
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005192
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,3584,64) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.010112
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.006412
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006412
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.009224
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005324
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005324
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.008128
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.007016
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007016
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007464
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.007212
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007212
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005948
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005948
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,896,16) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007332
[05/21/2021-07:41:49] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:41:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:41:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:49] [V] [TRT] Tactic: 1002 Time: 0.007576
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.009904
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004116
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004116
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.008208
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.006228
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006228
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.01198
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004504
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004504
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.007496
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,3136:2,56,1) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.00748
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.00524
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00524
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.00618
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.005856
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005856
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,448,8) -> Half(12544,1:16,224,4) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.006848
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006848
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(200704,1,3584,64) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.00694
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.00564
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00564
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Float(50176,1:4,896,16) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.006592
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.005808
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005808
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(200704,3136,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.009984
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.006688
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006688
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(100352,3136:2,56,1) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.00742
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.00666
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00666
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,224,4) -> Half(25088,1:8,448,8) (Reformat)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1002 Time: 0.006456
[05/21/2021-07:41:50] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:41:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:41:50] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:41:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:50] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:41:50] [V] [TRT] Tactic: 589823 Time: 0.023328
[05/21/2021-07:41:50] [V] [TRT] Tactic: 655359 Time: 0.016624
[05/21/2021-07:41:50] [V] [TRT] Tactic: 786431 Time: 0.014348
[05/21/2021-07:41:50] [V] [TRT] Tactic: 851967 Time: 0.015224
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1179647 Time: 0.012556
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1310719 Time: 0.015976
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1376255 Time: 0.020516
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1441791 Time: 0.01614
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1507327 Time: 0.015272
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1638399 Time: 0.014132
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1835007 Time: 0.015364
[05/21/2021-07:41:50] [V] [TRT] Tactic: 1900543 Time: 0.01848
[05/21/2021-07:41:50] [V] [TRT] Tactic: 2097151 Time: 0.013568
[05/21/2021-07:41:50] [V] [TRT] Tactic: 2162687 Time: 0.020624
[05/21/2021-07:41:50] [V] [TRT] Tactic: 2293759 Time: 0.019988
[05/21/2021-07:41:50] [V] [TRT] Tactic: 2359295 Time: 0.015844
[05/21/2021-07:41:50] [V] [TRT] Tactic: 2686975 Time: 0.019968
[05/21/2021-07:41:50] [V] [TRT] Tactic: 3080191 Time: 0.014464
[05/21/2021-07:41:50] [V] [TRT] Tactic: 3342335 Time: 0.015664
[05/21/2021-07:41:51] [V] [TRT] Tactic: 3407871 Time: 0.015712
[05/21/2021-07:41:51] [V] [TRT] Tactic: 3538943 Time: 0.014464
[05/21/2021-07:41:51] [V] [TRT] Tactic: 3670015 Time: 0.026752
[05/21/2021-07:41:51] [V] [TRT] Tactic: 3932159 Time: 0.017408
[05/21/2021-07:41:51] [V] [TRT] Tactic: 3997695 Time: 0.013468
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4063231 Time: 0.01334
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4194303 Time: 0.014336
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4259839 Time: 0.013472
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4325375 Time: 0.01344
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4521983 Time: 0.019584
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4587519 Time: 0.01376
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4653055 Time: 0.013996
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4915199 Time: 0.013528
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4980735 Time: 0.015488
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5177343 Time: 0.0131
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5242879 Time: 0.014992
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5373951 Time: 0.013712
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5439487 Time: 0.015488
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5570559 Time: 0.014848
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5636095 Time: 0.013696
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5701631 Time: 0.01874
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5767167 Time: 0.02164
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5832703 Time: 0.014632
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5898239 Time: 0.013184
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6029311 Time: 0.018816
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6225919 Time: 0.01408
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6291455 Time: 0.013
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6422527 Time: 0.014976
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6750207 Time: 0.01354
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6815743 Time: 0.01552
[05/21/2021-07:41:51] [V] [TRT] Tactic: 6946815 Time: 0.014976
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7012351 Time: 0.013184
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7077887 Time: 0.013312
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7143423 Time: 0.01568
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7208959 Time: 0.015744
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7340031 Time: 0.013312
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7405567 Time: 0.013992
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7536639 Time: 0.018224
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7602175 Time: 0.013568
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7733247 Time: 0.013824
[05/21/2021-07:41:51] [V] [TRT] Tactic: 7798783 Time: 0.014848
[05/21/2021-07:41:51] [V] [TRT] Tactic: 8191999 Time: 0.013952
[05/21/2021-07:41:51] [V] [TRT] Tactic: 8257535 Time: 0.013444
[05/21/2021-07:41:51] [V] [TRT] Tactic: 8323071 Time: 0.01434
[05/21/2021-07:41:51] [V] [TRT] Tactic: 8650751 Time: 0.014208
[05/21/2021-07:41:51] [V] [TRT] Tactic: 8716287 Time: 0.014764
[05/21/2021-07:41:51] [V] [TRT] Tactic: 9109503 Time: 0.013568
[05/21/2021-07:41:51] [V] [TRT] Tactic: 9568255 Time: 0.013568
[05/21/2021-07:41:51] [V] [TRT] Tactic: 9895935 Time: 0.014352
[05/21/2021-07:41:51] [V] [TRT] Tactic: 10223615 Time: 0.020016
[05/21/2021-07:41:51] [V] [TRT] Tactic: 10354687 Time: 0.012288
[05/21/2021-07:41:51] [V] [TRT] Tactic: 10551295 Time: 0.01536
[05/21/2021-07:41:51] [V] [TRT] Tactic: 10747903 Time: 0.013304
[05/21/2021-07:41:51] [V] [TRT] Tactic: 10944511 Time: 0.01472
[05/21/2021-07:41:51] [V] [TRT] Fastest Tactic: 10354687 Time: 0.012288
[05/21/2021-07:41:51] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:51] [V] [TRT] Tactic: 0 Time: 0.013312
[05/21/2021-07:41:51] [V] [TRT] Tactic: 1 Time: 0.013312
[05/21/2021-07:41:51] [V] [TRT] Tactic: 2 Time: 0.034224
[05/21/2021-07:41:51] [V] [TRT] Tactic: 4 Time: 0.370444
[05/21/2021-07:41:51] [V] [TRT] Tactic: 5 Time: 0.032432
[05/21/2021-07:41:51] [V] [TRT] Tactic: 56 Time: 0.014208
[05/21/2021-07:41:51] [V] [TRT] Tactic: 57 Time: 0.013696
[05/21/2021-07:41:51] [V] [TRT] Tactic: 58 Time: 0.03264
[05/21/2021-07:41:51] [V] [TRT] Tactic: 60 Time: 0.370208
[05/21/2021-07:41:51] [V] [TRT] Tactic: 61 Time: 0.032308
[05/21/2021-07:41:51] [V] [TRT] Tactic: 112 Time: 0.013792
[05/21/2021-07:41:51] [V] [TRT] Tactic: 113 Time: 0.013852
[05/21/2021-07:41:51] [V] [TRT] Tactic: 114 Time: 0.032512
[05/21/2021-07:41:51] [V] [TRT] Tactic: 116 Time: 0.371256
[05/21/2021-07:41:51] [V] [TRT] Tactic: 117 Time: 0.032368
[05/21/2021-07:41:51] [V] [TRT] Fastest Tactic: 0 Time: 0.013312
[05/21/2021-07:41:51] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:51] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:51] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:41:52] [V] [TRT] Tactic: 4549827808004681195 Time: 0.013872
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:41:52] [V] [TRT] Tactic: 5779835512569528575 Time: 0.015872
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:41:52] [V] [TRT] Tactic: 9151672657204310840 Time: 0.02496
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:41:52] [V] [TRT] Tactic: -7491730084094677098 Time: 0.01478
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:41:52] [V] [TRT] Tactic: -6622064180404051845 Time: 0.021212
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:41:52] [V] [TRT] Tactic: -6313876406580483184 Time: 0.014336
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:41:52] [V] [TRT] Tactic: -6273689210331812572 Time: 0.014968
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:41:52] [V] [TRT] Tactic: -4337126844824617177 Time: 0.01408
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:41:52] [V] [TRT] Tactic: -1123676555321336786 Time: 0.01622
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:41:52] [V] [TRT] Tactic: -701551393537224327 Time: 0.014464
[05/21/2021-07:41:52] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.013872
[05/21/2021-07:41:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10354687
[05/21/2021-07:41:52] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:41:52] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:52] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:52] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:52] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:41:52] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014612
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:41:52] [V] [TRT] Tactic: 2860655430572478466 Time: 0.011812
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:41:52] [V] [TRT] Tactic: 4474630279712975759 Time: 0.009928
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:41:52] [V] [TRT] Tactic: 4479823862704990365 Time: 0.009984
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:41:52] [V] [TRT] Tactic: 4696204239951173149 Time: 0.01236
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:41:52] [V] [TRT] Tactic: 5778138195697110003 Time: 0.014336
[05/21/2021-07:41:52] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:41:53] [V] [TRT] Tactic: 8918020581761223752 Time: 0.015744
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:41:53] [V] [TRT] Tactic: -5905193483742532701 Time: 0.01106
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:41:53] [V] [TRT] Tactic: -4035591156787122265 Time: 0.009856
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:41:53] [V] [TRT] Tactic: -2809379259463049391 Time: 0.014656
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:41:53] [V] [TRT] Tactic: -1985235291706575900 Time: 0.014464
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:41:53] [V] [TRT] Tactic: -504296718212024303 Time: 0.0134
[05/21/2021-07:41:53] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.009856
[05/21/2021-07:41:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:41:53] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:41:53] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:53] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:53] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:53] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:41:53] [V] [TRT] Tactic: 1373022415249282411 Time: 0.011268
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:41:53] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014316
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:41:53] [V] [TRT] Tactic: 2860655430572478466 Time: 0.012292
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:41:53] [V] [TRT] Tactic: 4474630279712975759 Time: 0.010172
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:41:53] [V] [TRT] Tactic: 4479823862704990365 Time: 0.010112
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:41:53] [V] [TRT] Tactic: 4696204239951173149 Time: 0.01148
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:41:53] [V] [TRT] Tactic: 5778138195697110003 Time: 0.014848
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:41:53] [V] [TRT] Tactic: 8918020581761223752 Time: 0.014336
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:41:53] [V] [TRT] Tactic: -7067026478815706014 Time: 0.013696
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:41:53] [V] [TRT] Tactic: -5905193483742532701 Time: 0.01024
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:41:53] [V] [TRT] Tactic: -4035591156787122265 Time: 0.009216
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:41:53] [V] [TRT] Tactic: -2809379259463049391 Time: 0.014336
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:41:53] [V] [TRT] Tactic: -1985235291706575900 Time: 0.01526
[05/21/2021-07:41:53] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:41:53] [V] [TRT] Tactic: -504296718212024303 Time: 0.014592
[05/21/2021-07:41:53] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.009216
[05/21/2021-07:41:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:41:53] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:41:53] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:53] [V] [TRT] Tactic: 0 Time: 0.014712
[05/21/2021-07:41:53] [V] [TRT] Tactic: 1 Time: 0.014772
[05/21/2021-07:41:53] [V] [TRT] Tactic: 2 Time: 0.033148
[05/21/2021-07:41:53] [V] [TRT] Tactic: 4 Time: 0.37116
[05/21/2021-07:41:53] [V] [TRT] Tactic: 5 Time: 0.032476
[05/21/2021-07:41:53] [V] [TRT] Tactic: 56 Time: 0.014584
[05/21/2021-07:41:53] [V] [TRT] Tactic: 58 Time: 0.033296
[05/21/2021-07:41:53] [V] [TRT] Tactic: 60 Time: 0.371328
[05/21/2021-07:41:53] [V] [TRT] Tactic: 61 Time: 0.032456
[05/21/2021-07:41:53] [V] [TRT] Fastest Tactic: 56 Time: 0.014584
[05/21/2021-07:41:53] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:54] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:41:54] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:41:54] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:54] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:41:54] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:41:54] [V] [TRT] Tactic: 589823 Time: 0.014208
[05/21/2021-07:41:54] [V] [TRT] Tactic: 655359 Time: 0.011396
[05/21/2021-07:41:54] [V] [TRT] Tactic: 786431 Time: 0.009784
[05/21/2021-07:41:54] [V] [TRT] Tactic: 851967 Time: 0.011264
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1179647 Time: 0.008604
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1310719 Time: 0.010772
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1376255 Time: 0.012416
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1441791 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1507327 Time: 0.009344
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1638399 Time: 0.009088
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1835007 Time: 0.010112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 1900543 Time: 0.012312
[05/21/2021-07:41:54] [V] [TRT] Tactic: 2097151 Time: 0.009264
[05/21/2021-07:41:54] [V] [TRT] Tactic: 2162687 Time: 0.012948
[05/21/2021-07:41:54] [V] [TRT] Tactic: 2293759 Time: 0.013056
[05/21/2021-07:41:54] [V] [TRT] Tactic: 2359295 Time: 0.010416
[05/21/2021-07:41:54] [V] [TRT] Tactic: 2686975 Time: 0.01242
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3080191 Time: 0.009344
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3342335 Time: 0.01
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3407871 Time: 0.010156
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3538943 Time: 0.009352
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3670015 Time: 0.01728
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3932159 Time: 0.0112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 3997695 Time: 0.009292
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4063231 Time: 0.0096
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4194303 Time: 0.009472
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4259839 Time: 0.009344
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4325375 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4521983 Time: 0.01232
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4587519 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4653055 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4915199 Time: 0.009088
[05/21/2021-07:41:54] [V] [TRT] Tactic: 4980735 Time: 0.009404
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5177343 Time: 0.008368
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5242879 Time: 0.009712
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5373951 Time: 0.009208
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5439487 Time: 0.010112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5570559 Time: 0.00966
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5636095 Time: 0.009636
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5701631 Time: 0.012032
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5767167 Time: 0.013172
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5832703 Time: 0.009868
[05/21/2021-07:41:54] [V] [TRT] Tactic: 5898239 Time: 0.009244
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6029311 Time: 0.01216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6225919 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6291455 Time: 0.008576
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6422527 Time: 0.009344
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6750207 Time: 0.009088
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6815743 Time: 0.010368
[05/21/2021-07:41:54] [V] [TRT] Tactic: 6946815 Time: 0.010112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7012351 Time: 0.009508
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7077887 Time: 0.008868
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7143423 Time: 0.01038
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7208959 Time: 0.010112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7340031 Time: 0.009108
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7405567 Time: 0.009132
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7536639 Time: 0.011264
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7602175 Time: 0.008832
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7733247 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 7798783 Time: 0.010112
[05/21/2021-07:41:54] [V] [TRT] Tactic: 8191999 Time: 0.008488
[05/21/2021-07:41:54] [V] [TRT] Tactic: 8257535 Time: 0.008448
[05/21/2021-07:41:54] [V] [TRT] Tactic: 8323071 Time: 0.009216
[05/21/2021-07:41:54] [V] [TRT] Tactic: 8650751 Time: 0.0096
[05/21/2021-07:41:54] [V] [TRT] Tactic: 8716287 Time: 0.009472
[05/21/2021-07:41:54] [V] [TRT] Tactic: 9109503 Time: 0.009344
[05/21/2021-07:41:54] [V] [TRT] Tactic: 9568255 Time: 0.009088
[05/21/2021-07:41:54] [V] [TRT] Tactic: 9895935 Time: 0.00938
[05/21/2021-07:41:54] [V] [TRT] Tactic: 10223615 Time: 0.012588
[05/21/2021-07:41:55] [V] [TRT] Tactic: 10354687 Time: 0.008968
[05/21/2021-07:41:55] [V] [TRT] Tactic: 10551295 Time: 0.010392
[05/21/2021-07:41:55] [V] [TRT] Tactic: 10747903 Time: 0.009216
[05/21/2021-07:41:55] [V] [TRT] Tactic: 10944511 Time: 0.010012
[05/21/2021-07:41:55] [V] [TRT] Fastest Tactic: 5177343 Time: 0.008368
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2195670545862694453 Time: 0.01018
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3891805945559659536 Time: 0.01156
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:41:55] [V] [TRT] Tactic: 4418200634486186714 Time: 0.008312
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:41:55] [V] [TRT] Tactic: 5548126322150286555 Time: 0.009216
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:41:55] [V] [TRT] Tactic: 6057304366605292508 Time: 0.009216
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:41:55] [V] [TRT] Tactic: 7392644644614664811 Time: 0.009216
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:41:55] [V] [TRT] Tactic: -4884039206922900293 Time: 0.01152
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:41:55] [V] [TRT] Tactic: -4374269919094467161 Time: 0.009608
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:41:55] [V] [TRT] Tactic: -1546027692247304867 Time: 0.011416
[05/21/2021-07:41:55] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.008312
[05/21/2021-07:41:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:41:55] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:41:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:55] [V] [TRT] Tactic: 0 Time: 0.129404
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1 Time: 0.020956
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2 Time: 0.037088
[05/21/2021-07:41:55] [V] [TRT] Tactic: 56 Time: 0.13122
[05/21/2021-07:41:55] [V] [TRT] Tactic: 58 Time: 0.03792
[05/21/2021-07:41:55] [V] [TRT] Fastest Tactic: 1 Time: 0.020956
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:55] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:41:55] [V] [TRT] Tactic: 254850674756030979 Time: 0.010212
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1156328698016730421 Time: 0.00832
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1362727228442059924 Time: 0.008064
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1576319725282257846 Time: 0.007592
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1832046141070096030 Time: 0.007168
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1838082074606840426 Time: 0.007452
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:41:55] [V] [TRT] Tactic: 1899296423087490472 Time: 0.00704
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2238656696610018305 Time: 0.007244
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2541579301352125276 Time: 0.007424
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2559328254295148085 Time: 0.009188
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2657157263811141609 Time: 0.007296
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:41:55] [V] [TRT] Tactic: 2968605903460894194 Time: 0.007648
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3071479995783211391 Time: 0.007424
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3359475309458902373 Time: 0.007552
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3362537467505018070 Time: 0.008192
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3513075359009385578 Time: 0.01024
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3704534001553878387 Time: 0.008144
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:41:55] [V] [TRT] Tactic: 3899310434460415852 Time: 0.006144
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:41:55] [V] [TRT] Tactic: 4278315135102886928 Time: 0.00704
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:41:55] [V] [TRT] Tactic: 4370476717970497892 Time: 0.00704
[05/21/2021-07:41:55] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007012
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4491683531415781597 Time: 0.009984
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4528997467275241200 Time: 0.007168
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4571819373777460444 Time: 0.009796
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4595173549602041350 Time: 0.009196
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4802447371470387646 Time: 0.009124
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:41:56] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00682
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:41:56] [V] [TRT] Tactic: 5059676457552313631 Time: 0.009952
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:41:56] [V] [TRT] Tactic: 5205510332404400949 Time: 0.007748
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:41:56] [V] [TRT] Tactic: 5346855796032465921 Time: 0.008848
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:41:56] [V] [TRT] Tactic: 5398999388616959893 Time: 0.008804
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:41:56] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00704
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:41:56] [V] [TRT] Tactic: 6377497238381488891 Time: 0.008072
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:41:56] [V] [TRT] Tactic: 6468794451065529747 Time: 0.007552
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:41:56] [V] [TRT] Tactic: 6697277555581639516 Time: 0.006172
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:41:56] [V] [TRT] Tactic: 6859477213531075460 Time: 0.006364
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:41:56] [V] [TRT] Tactic: 7216571380637776659 Time: 0.008192
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:41:56] [V] [TRT] Tactic: 7609923741161019135 Time: 0.007284
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:41:56] [V] [TRT] Tactic: 8101703987960976805 Time: 0.007296
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:41:56] [V] [TRT] Tactic: 8170606396342855895 Time: 0.007436
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:41:56] [V] [TRT] Tactic: 8764780417487154889 Time: 0.008784
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:41:56] [V] [TRT] Tactic: 8823554289762712606 Time: 0.006912
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:41:56] [V] [TRT] Tactic: 8839784824303350101 Time: 0.008324
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:41:56] [V] [TRT] Tactic: -9203179519031456182 Time: 0.006144
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:41:56] [V] [TRT] Tactic: -9009272790678027912 Time: 0.008832
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:41:56] [V] [TRT] Tactic: -8604374562669615024 Time: 0.006144
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:41:56] [V] [TRT] Tactic: -8280443484414412687 Time: 0.009652
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:41:56] [V] [TRT] Tactic: -8205952393017864204 Time: 0.009208
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:41:56] [V] [TRT] Tactic: -8131857373260504832 Time: 0.006356
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:41:56] [V] [TRT] Tactic: -7410012245391920273 Time: 0.006528
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:41:56] [V] [TRT] Tactic: -7099920365135295801 Time: 0.006128
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:41:56] [V] [TRT] Tactic: -7089118800560870395 Time: 0.006736
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:41:56] [V] [TRT] Tactic: -6768327495007644783 Time: 0.00832
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:41:56] [V] [TRT] Tactic: -6356316196810535311 Time: 0.00704
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:41:56] [V] [TRT] Tactic: -6063766379489217211 Time: 0.006912
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:41:56] [V] [TRT] Tactic: -5530886555766748586 Time: 0.008064
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:41:56] [V] [TRT] Tactic: -5409588854490562130 Time: 0.006144
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:41:56] [V] [TRT] Tactic: -5161596964442251102 Time: 0.007968
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:41:56] [V] [TRT] Tactic: -5127240325355316006 Time: 0.00704
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4950923835688973492 Time: 0.006272
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4796511246675321840 Time: 0.007876
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4548822885169694805 Time: 0.006764
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00666
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4293222705763522367 Time: 0.006272
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:41:56] [V] [TRT] Tactic: -4152066959007262150 Time: 0.009656
[05/21/2021-07:41:56] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:41:57] [V] [TRT] Tactic: -4021926646879732549 Time: 0.00704
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3987638434926559037 Time: 0.008332
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3905653247016903130 Time: 0.008704
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3903342530518878192 Time: 0.008192
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3864869056275745423 Time: 0.008576
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0064
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:41:57] [V] [TRT] Tactic: -3058330359340425555 Time: 0.007672
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:41:57] [V] [TRT] Tactic: -2878731503146438856 Time: 0.00878
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:41:57] [V] [TRT] Tactic: -2602982885923184927 Time: 0.008056
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:41:57] [V] [TRT] Tactic: -2353603993968373338 Time: 0.008576
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:41:57] [V] [TRT] Tactic: -2032577876140256150 Time: 0.007168
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:41:57] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0064
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:41:57] [V] [TRT] Tactic: -1985778916402815946 Time: 0.008576
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:41:57] [V] [TRT] Tactic: -1828674067637788567 Time: 0.007192
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:41:57] [V] [TRT] Tactic: -1640527254204634147 Time: 0.007192
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:41:57] [V] [TRT] Tactic: -1562548049711204899 Time: 0.007396
[05/21/2021-07:41:57] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:41:58] [V] [TRT] Tactic: -1242202084391243207 Time: 0.006508
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:41:58] [V] [TRT] Tactic: -1099247066487349374 Time: 0.006508
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:41:58] [V] [TRT] Tactic: -1038291877007553549 Time: 0.006912
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:41:58] [V] [TRT] Tactic: -406984317033388136 Time: 0.007984
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:41:58] [V] [TRT] Tactic: -331499326992534460 Time: 0.006144
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:41:58] [V] [TRT] Tactic: -206523504474952360 Time: 0.007328
[05/21/2021-07:41:58] [V] [TRT] Fastest Tactic: -7099920365135295801 Time: 0.006128
[05/21/2021-07:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7099920365135295801
[05/21/2021-07:41:58] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:41:58] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:41:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:58] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CublasConvolution)
[05/21/2021-07:41:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:58] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv1 + stage1_unit1_relu2 (CaskConvolution)
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:41:58] [V] [TRT] Tactic: 162720039126739803 Time: 0.0052
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:41:58] [V] [TRT] Tactic: 382577144988222004 Time: 0.006784
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:41:58] [V] [TRT] Tactic: 2334614616543277495 Time: 0.006856
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:41:58] [V] [TRT] Tactic: 4126996489741716394 Time: 0.006204
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:41:58] [V] [TRT] Tactic: 6466136707377588846 Time: 0.00832
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:41:58] [V] [TRT] Tactic: 6958123061428231366 Time: 0.006864
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:41:58] [V] [TRT] Tactic: 8940522081427638481 Time: 0.006016
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:41:58] [V] [TRT] Tactic: -7023377647582255231 Time: 0.00628
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:41:58] [V] [TRT] Tactic: -6148657501329441429 Time: 0.006988
[05/21/2021-07:41:58] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:41:58] [V] [TRT] Tactic: -3396930063803107917 Time: 0.008192
[05/21/2021-07:41:58] [V] [TRT] Fastest Tactic: 162720039126739803 Time: 0.0052
[05/21/2021-07:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 162720039126739803
[05/21/2021-07:41:58] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:41:58] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:41:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:41:58] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:41:58] [V] [TRT] Tactic: 524287 Time: 0.034816
[05/21/2021-07:41:58] [V] [TRT] Tactic: 720895 Time: 0.03072
[05/21/2021-07:41:58] [V] [TRT] Tactic: 983039 Time: 0.023664
[05/21/2021-07:41:58] [V] [TRT] Tactic: 1048575 Time: 0.031236
[05/21/2021-07:41:58] [V] [TRT] Tactic: 1703935 Time: 0.023936
[05/21/2021-07:41:58] [V] [TRT] Tactic: 1769471 Time: 0.03126
[05/21/2021-07:41:59] [V] [TRT] Tactic: 1966079 Time: 0.054324
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2031615 Time: 0.045824
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2228223 Time: 0.028728
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2424831 Time: 0.026388
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2621439 Time: 0.024364
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2752511 Time: 0.03392
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2818047 Time: 0.044988
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2883583 Time: 0.059952
[05/21/2021-07:41:59] [V] [TRT] Tactic: 3014655 Time: 0.0224
[05/21/2021-07:41:59] [V] [TRT] Tactic: 3145727 Time: 0.02624
[05/21/2021-07:41:59] [V] [TRT] Tactic: 3473407 Time: 0.049936
[05/21/2021-07:41:59] [V] [TRT] Tactic: 3604479 Time: 0.023936
[05/21/2021-07:41:59] [V] [TRT] Tactic: 3735551 Time: 0.040076
[05/21/2021-07:41:59] [V] [TRT] Tactic: 4390911 Time: 0.055168
[05/21/2021-07:41:59] [V] [TRT] Tactic: 5046271 Time: 0.028116
[05/21/2021-07:41:59] [V] [TRT] Tactic: 5963775 Time: 0.047104
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6160383 Time: 0.03264
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6488063 Time: 0.029696
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6881279 Time: 0.04224
[05/21/2021-07:41:59] [V] [TRT] Tactic: 7274495 Time: 0.021892
[05/21/2021-07:41:59] [V] [TRT] Tactic: 7864319 Time: 0.021504
[05/21/2021-07:41:59] [V] [TRT] Tactic: 7995391 Time: 0.033792
[05/21/2021-07:41:59] [V] [TRT] Tactic: 8585215 Time: 0.039424
[05/21/2021-07:41:59] [V] [TRT] Tactic: 8847359 Time: 0.025944
[05/21/2021-07:41:59] [V] [TRT] Tactic: 8978431 Time: 0.0483
[05/21/2021-07:41:59] [V] [TRT] Tactic: 9043967 Time: 0.023552
[05/21/2021-07:41:59] [V] [TRT] Tactic: 9175039 Time: 0.023744
[05/21/2021-07:41:59] [V] [TRT] Tactic: 9502719 Time: 0.0544
[05/21/2021-07:41:59] [V] [TRT] Tactic: 9830399 Time: 0.03804
[05/21/2021-07:41:59] [V] [TRT] Tactic: 9961471 Time: 0.02936
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10027007 Time: 0.031428
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10092543 Time: 0.05568
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10289151 Time: 0.0544
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10485759 Time: 0.022912
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10682367 Time: 0.022956
[05/21/2021-07:41:59] [V] [TRT] Tactic: 10813439 Time: 0.0256
[05/21/2021-07:41:59] [V] [TRT] Fastest Tactic: 7864319 Time: 0.021504
[05/21/2021-07:41:59] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:41:59] [V] [TRT] Tactic: 0 Time: 0.040132
[05/21/2021-07:41:59] [V] [TRT] Tactic: 1 Time: 0.028672
[05/21/2021-07:41:59] [V] [TRT] Tactic: 2 Time: 0.087992
[05/21/2021-07:41:59] [V] [TRT] Tactic: 4 Time: 0.371244
[05/21/2021-07:41:59] [V] [TRT] Tactic: 5 Time: 0.16854
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6 Time: 0.025756
[05/21/2021-07:41:59] [V] [TRT] Tactic: 56 Time: 0.041488
[05/21/2021-07:41:59] [V] [TRT] Tactic: 57 Time: 0.030976
[05/21/2021-07:41:59] [V] [TRT] Tactic: 58 Time: 0.08874
[05/21/2021-07:41:59] [V] [TRT] Tactic: 60 Time: 0.371616
[05/21/2021-07:41:59] [V] [TRT] Tactic: 61 Time: 0.1669
[05/21/2021-07:41:59] [V] [TRT] Tactic: 62 Time: 0.024448
[05/21/2021-07:41:59] [V] [TRT] Tactic: 112 Time: 0.040472
[05/21/2021-07:41:59] [V] [TRT] Tactic: 113 Time: 0.040468
[05/21/2021-07:41:59] [V] [TRT] Tactic: 114 Time: 0.088536
[05/21/2021-07:41:59] [V] [TRT] Tactic: 116 Time: 0.372384
[05/21/2021-07:41:59] [V] [TRT] Tactic: 117 Time: 0.167576
[05/21/2021-07:41:59] [V] [TRT] Tactic: 118 Time: 0.024452
[05/21/2021-07:41:59] [V] [TRT] Fastest Tactic: 62 Time: 0.024448
[05/21/2021-07:41:59] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:41:59] [V] [TRT] Tactic: 4549827808004681195 Time: 0.055296
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:41:59] [V] [TRT] Tactic: 5779835512569528575 Time: 0.069484
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6053873026024413720 Time: 0.070668
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:41:59] [V] [TRT] Tactic: 6767548733843469815 Time: 0.05644
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:41:59] [V] [TRT] Tactic: -6313876406580483184 Time: 0.069632
[05/21/2021-07:41:59] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:00] [V] [TRT] Tactic: -1123676555321336786 Time: 0.071088
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:00] [V] [TRT] Tactic: -701551393537224327 Time: 0.0616
[05/21/2021-07:42:00] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.055296
[05/21/2021-07:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319
[05/21/2021-07:42:00] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:00] [V] [TRT] Tactic: 2860655430572478466 Time: 0.043036
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026496
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4479823862704990365 Time: 0.02624
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.043156
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:00] [V] [TRT] Tactic: 5778138195697110003 Time: 0.069504
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:42:00] [V] [TRT] Tactic: 7155825427510256858 Time: 0.068116
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.066728
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:42:00] [V] [TRT] Tactic: -4756382386362004279 Time: 0.041856
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:42:00] [V] [TRT] Tactic: -3855385237722507464 Time: 0.069512
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.067788
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:00] [V] [TRT] Tactic: -504296718212024303 Time: 0.067912
[05/21/2021-07:42:00] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.02624
[05/21/2021-07:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:42:00] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:00] [V] [TRT] Tactic: 2860655430572478466 Time: 0.042752
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026196
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025728
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.04288
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:00] [V] [TRT] Tactic: 5778138195697110003 Time: 0.069252
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:42:00] [V] [TRT] Tactic: 7155825427510256858 Time: 0.067872
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:42:00] [V] [TRT] Tactic: 7342025736444949634 Time: 0.049932
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.065944
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:42:00] [V] [TRT] Tactic: -7377458734869418330 Time: 0.046208
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:42:00] [V] [TRT] Tactic: -5457304872213719461 Time: 0.046976
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:42:00] [V] [TRT] Tactic: -4756382386362004279 Time: 0.043004
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:42:00] [V] [TRT] Tactic: -3855385237722507464 Time: 0.071352
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.069164
[05/21/2021-07:42:00] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:00] [V] [TRT] Tactic: -504296718212024303 Time: 0.067116
[05/21/2021-07:42:00] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.025728
[05/21/2021-07:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:42:00] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:00] [V] [TRT] Tactic: 0 Time: 0.047408
[05/21/2021-07:42:00] [V] [TRT] Tactic: 1 Time: 0.047384
[05/21/2021-07:42:00] [V] [TRT] Tactic: 2 Time: 0.076544
[05/21/2021-07:42:00] [V] [TRT] Tactic: 4 Time: 0.371248
[05/21/2021-07:42:00] [V] [TRT] Tactic: 5 Time: 0.165992
[05/21/2021-07:42:00] [V] [TRT] Tactic: 6 Time: 0.040352
[05/21/2021-07:42:00] [V] [TRT] Tactic: 56 Time: 0.047268
[05/21/2021-07:42:00] [V] [TRT] Tactic: 58 Time: 0.077544
[05/21/2021-07:42:00] [V] [TRT] Tactic: 60 Time: 0.370296
[05/21/2021-07:42:00] [V] [TRT] Tactic: 61 Time: 0.168776
[05/21/2021-07:42:00] [V] [TRT] Tactic: 62 Time: 0.04034
[05/21/2021-07:42:00] [V] [TRT] Fastest Tactic: 62 Time: 0.04034
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62
[05/21/2021-07:42:00] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:42:00] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:42:00] [V] [TRT] Tactic: 524287 Time: 0.023556
[05/21/2021-07:42:00] [V] [TRT] Tactic: 720895 Time: 0.021248
[05/21/2021-07:42:00] [V] [TRT] Tactic: 983039 Time: 0.016868
[05/21/2021-07:42:00] [V] [TRT] Tactic: 1048575 Time: 0.02252
[05/21/2021-07:42:00] [V] [TRT] Tactic: 1703935 Time: 0.018192
[05/21/2021-07:42:00] [V] [TRT] Tactic: 1769471 Time: 0.02176
[05/21/2021-07:42:00] [V] [TRT] Tactic: 1966079 Time: 0.03472
[05/21/2021-07:42:00] [V] [TRT] Tactic: 2031615 Time: 0.030732
[05/21/2021-07:42:00] [V] [TRT] Tactic: 2228223 Time: 0.018704
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2424831 Time: 0.01856
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2621439 Time: 0.01792
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2752511 Time: 0.023636
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2818047 Time: 0.03072
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2883583 Time: 0.04096
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3014655 Time: 0.017448
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3145727 Time: 0.020176
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3473407 Time: 0.034944
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3604479 Time: 0.017536
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3735551 Time: 0.029228
[05/21/2021-07:42:01] [V] [TRT] Tactic: 4390911 Time: 0.037124
[05/21/2021-07:42:01] [V] [TRT] Tactic: 5046271 Time: 0.019328
[05/21/2021-07:42:01] [V] [TRT] Tactic: 5963775 Time: 0.032184
[05/21/2021-07:42:01] [V] [TRT] Tactic: 6160383 Time: 0.022528
[05/21/2021-07:42:01] [V] [TRT] Tactic: 6488063 Time: 0.01984
[05/21/2021-07:42:01] [V] [TRT] Tactic: 6881279 Time: 0.02764
[05/21/2021-07:42:01] [V] [TRT] Tactic: 7274495 Time: 0.014608
[05/21/2021-07:42:01] [V] [TRT] Tactic: 7864319 Time: 0.014552
[05/21/2021-07:42:01] [V] [TRT] Tactic: 7995391 Time: 0.021808
[05/21/2021-07:42:01] [V] [TRT] Tactic: 8585215 Time: 0.025856
[05/21/2021-07:42:01] [V] [TRT] Tactic: 8847359 Time: 0.015504
[05/21/2021-07:42:01] [V] [TRT] Tactic: 8978431 Time: 0.031732
[05/21/2021-07:42:01] [V] [TRT] Tactic: 9043967 Time: 0.01626
[05/21/2021-07:42:01] [V] [TRT] Tactic: 9175039 Time: 0.01728
[05/21/2021-07:42:01] [V] [TRT] Tactic: 9502719 Time: 0.036868
[05/21/2021-07:42:01] [V] [TRT] Tactic: 9830399 Time: 0.02754
[05/21/2021-07:42:01] [V] [TRT] Tactic: 9961471 Time: 0.019628
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10027007 Time: 0.02176
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10092543 Time: 0.036956
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10289151 Time: 0.034572
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10485759 Time: 0.016428
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10682367 Time: 0.017704
[05/21/2021-07:42:01] [V] [TRT] Tactic: 10813439 Time: 0.019604
[05/21/2021-07:42:01] [V] [TRT] Fastest Tactic: 7864319 Time: 0.014552
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2195670545862694453 Time: 0.034808
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3419182076704469245 Time: 0.033792
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:01] [V] [TRT] Tactic: 3891805945559659536 Time: 0.046836
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:01] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0341
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:01] [V] [TRT] Tactic: 6057304366605292508 Time: 0.030884
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:42:01] [V] [TRT] Tactic: -7928611605886347652 Time: 0.04814
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:42:01] [V] [TRT] Tactic: -5172391392092686714 Time: 0.03716
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:01] [V] [TRT] Tactic: -4374269919094467161 Time: 0.030592
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953
[05/21/2021-07:42:01] [V] [TRT] Tactic: -4083394051665370953 Time: 0.011264
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:01] [V] [TRT] Tactic: -1546027692247304867 Time: 0.046384
[05/21/2021-07:42:01] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.011264
[05/21/2021-07:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953
[05/21/2021-07:42:01] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:01] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:01] [V] [TRT] Tactic: 0 Time: 0.954156
[05/21/2021-07:42:01] [V] [TRT] Tactic: 1 Time: 0.110356
[05/21/2021-07:42:01] [V] [TRT] Tactic: 2 Time: 0.11776
[05/21/2021-07:42:01] [V] [TRT] Tactic: 6 Time: 0.032768
[05/21/2021-07:42:01] [V] [TRT] Tactic: 56 Time: 0.954496
[05/21/2021-07:42:01] [V] [TRT] Tactic: 58 Time: 0.12086
[05/21/2021-07:42:01] [V] [TRT] Tactic: 62 Time: 0.033996
[05/21/2021-07:42:01] [V] [TRT] Fastest Tactic: 6 Time: 0.032768
[05/21/2021-07:42:01] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.027684
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:42:01] [V] [TRT] Tactic: 328038211831149625 Time: 0.027264
[05/21/2021-07:42:01] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:42:02] [V] [TRT] Tactic: 411553864378931917 Time: 0.01216
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1011057357468998345 Time: 0.018176
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1156328698016730421 Time: 0.017792
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1723736032573714698 Time: 0.011388
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011664
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011828
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:02] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009488
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2428167804343994714 Time: 0.01088
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0164
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2657157263811141609 Time: 0.010032
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2819719497590964443 Time: 0.012544
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2968605903460894194 Time: 0.012032
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:42:02] [V] [TRT] Tactic: 2986078304285316765 Time: 0.016944
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:02] [V] [TRT] Tactic: 3362537467505018070 Time: 0.016576
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:02] [V] [TRT] Tactic: 3513075359009385578 Time: 0.027924
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:42:02] [V] [TRT] Tactic: 3573559043797674382 Time: 0.01216
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:42:02] [V] [TRT] Tactic: 3591970081995419777 Time: 0.009504
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:02] [V] [TRT] Tactic: 3704534001553878387 Time: 0.017436
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:02] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011392
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:42:02] [V] [TRT] Tactic: 4503233883285355107 Time: 0.009216
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:02] [V] [TRT] Tactic: 4802447371470387646 Time: 0.018716
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:02] [V] [TRT] Tactic: 5059676457552313631 Time: 0.027144
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:42:02] [V] [TRT] Tactic: 5368829646735632944 Time: 0.0094
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:02] [V] [TRT] Tactic: 5398999388616959893 Time: 0.017576
[05/21/2021-07:42:02] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:42:03] [V] [TRT] Tactic: 5746691132547383910 Time: 0.012032
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:42:03] [V] [TRT] Tactic: 5770170567977052602 Time: 0.019456
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:42:03] [V] [TRT] Tactic: 5953552212833506549 Time: 0.017664
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01128
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6074229447555668232 Time: 0.009484
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6154447660803990543 Time: 0.012416
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6325769668000961702 Time: 0.018004
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6350273239113254096 Time: 0.014276
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6377497238381488891 Time: 0.016672
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6446388116965632819 Time: 0.011908
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6468794451065529747 Time: 0.012332
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6642277870194067185 Time: 0.02816
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009216
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6972489290272968208 Time: 0.015744
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:42:03] [V] [TRT] Tactic: 6979044990896381511 Time: 0.026724
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:03] [V] [TRT] Tactic: 7216571380637776659 Time: 0.01924
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:03] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011264
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:42:03] [V] [TRT] Tactic: 7705739241028240201 Time: 0.01024
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:42:03] [V] [TRT] Tactic: 8072087735545283117 Time: 0.027648
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:03] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009756
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:03] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01212
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:03] [V] [TRT] Tactic: 8839784824303350101 Time: 0.018176
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:42:03] [V] [TRT] Tactic: -9217371357561775773 Time: 0.009836
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:03] [V] [TRT] Tactic: -9009272790678027912 Time: 0.019492
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:42:03] [V] [TRT] Tactic: -8985224497679592364 Time: 0.009184
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:42:03] [V] [TRT] Tactic: -8949544755481315679 Time: 0.01216
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:42:03] [V] [TRT] Tactic: -8759929675070720385 Time: 0.016256
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:03] [V] [TRT] Tactic: -8604374562669615024 Time: 0.010008
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013712
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6840588038605932325 Time: 0.011648
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6799856376604253964 Time: 0.027392
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6625722781282978136 Time: 0.012568
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6525498856028268801 Time: 0.017472
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6356316196810535311 Time: 0.010152
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6324345858751792783 Time: 0.012416
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6262400699544994312 Time: 0.026696
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6257787336162086472 Time: 0.017792
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:03] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011396
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:42:03] [V] [TRT] Tactic: -5777580938094193096 Time: 0.010776
[05/21/2021-07:42:03] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:42:04] [V] [TRT] Tactic: -5657273398217409378 Time: 0.02816
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:04] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016436
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:42:04] [V] [TRT] Tactic: -5422685219138380548 Time: 0.011292
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:04] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011704
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:04] [V] [TRT] Tactic: -5127240325355316006 Time: 0.011184
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4825567853927730435 Time: 0.01152
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4796511246675321840 Time: 0.012204
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4706569565442112734 Time: 0.010112
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4566599693570369588 Time: 0.017664
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4409144516525410768 Time: 0.016476
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011252
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4152066959007262150 Time: 0.027648
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:04] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011264
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3987638434926559037 Time: 0.013188
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3905653247016903130 Time: 0.018372
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3903974568488493144 Time: 0.012416
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3895429239811098010 Time: 0.011304
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01884
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00896
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3412636942650049698 Time: 0.018444
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3338665856053412950 Time: 0.01772
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:04] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011392
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2816084650627734155 Time: 0.01996
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2662892962457732243 Time: 0.010612
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2559894581585337900 Time: 0.028468
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2530740716768816092 Time: 0.016392
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2332828394978346992 Time: 0.017504
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2241736083352441442 Time: 0.019456
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:42:04] [V] [TRT] Tactic: -2161909437867201546 Time: 0.013236
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:04] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01972
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:42:04] [V] [TRT] Tactic: -1500496213132463076 Time: 0.01246
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:04] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009344
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:42:04] [V] [TRT] Tactic: -910286698936744682 Time: 0.0097
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:42:04] [V] [TRT] Tactic: -606726295133751039 Time: 0.011176
[05/21/2021-07:42:04] [V] [TRT] Fastest Tactic: -3601464762214218301 Time: 0.00896
[05/21/2021-07:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3601464762214218301
[05/21/2021-07:42:04] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:42:04] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:04] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv2 + stage1_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:42:04] [V] [TRT] Tactic: 1301213148470244380 Time: 0.009332
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:42:04] [V] [TRT] Tactic: 2140378925901736289 Time: 0.009336
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:42:04] [V] [TRT] Tactic: 7019285522757193163 Time: 0.011548
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:42:04] [V] [TRT] Tactic: 7616509406849244401 Time: 0.011816
[05/21/2021-07:42:04] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:42:04] [V] [TRT] Tactic: -6575010824547653277 Time: 0.013352
[05/21/2021-07:42:04] [V] [TRT] Fastest Tactic: 1301213148470244380 Time: 0.009332
[05/21/2021-07:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1301213148470244380
[05/21/2021-07:42:04] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:04] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:04] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:42:04] [V] [TRT] Tactic: 589823 Time: 0.04096
[05/21/2021-07:42:05] [V] [TRT] Tactic: 655359 Time: 0.037888
[05/21/2021-07:42:05] [V] [TRT] Tactic: 786431 Time: 0.036352
[05/21/2021-07:42:05] [V] [TRT] Tactic: 851967 Time: 0.0352
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1179647 Time: 0.035484
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1310719 Time: 0.034232
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1376255 Time: 0.03648
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1441791 Time: 0.037172
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1507327 Time: 0.036628
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1638399 Time: 0.0359
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1835007 Time: 0.038656
[05/21/2021-07:42:05] [V] [TRT] Tactic: 1900543 Time: 0.038912
[05/21/2021-07:42:05] [V] [TRT] Tactic: 2097151 Time: 0.035712
[05/21/2021-07:42:05] [V] [TRT] Tactic: 2162687 Time: 0.036872
[05/21/2021-07:42:05] [V] [TRT] Tactic: 2293759 Time: 0.037152
[05/21/2021-07:42:05] [V] [TRT] Tactic: 2359295 Time: 0.034108
[05/21/2021-07:42:05] [V] [TRT] Tactic: 2686975 Time: 0.038144
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3080191 Time: 0.034944
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3342335 Time: 0.037144
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3407871 Time: 0.035456
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3538943 Time: 0.03484
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3670015 Time: 0.047744
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3932159 Time: 0.037016
[05/21/2021-07:42:05] [V] [TRT] Tactic: 3997695 Time: 0.0361
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4063231 Time: 0.036224
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4194303 Time: 0.036636
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4259839 Time: 0.03512
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4325375 Time: 0.034048
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4521983 Time: 0.036944
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4587519 Time: 0.034336
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4653055 Time: 0.034048
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4915199 Time: 0.034476
[05/21/2021-07:42:05] [V] [TRT] Tactic: 4980735 Time: 0.034956
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5177343 Time: 0.036864
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5242879 Time: 0.03308
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5373951 Time: 0.039252
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5439487 Time: 0.04096
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5570559 Time: 0.034048
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5636095 Time: 0.03648
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5701631 Time: 0.037012
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5767167 Time: 0.068264
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5832703 Time: 0.033668
[05/21/2021-07:42:05] [V] [TRT] Tactic: 5898239 Time: 0.035456
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6029311 Time: 0.036372
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6225919 Time: 0.034864
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6291455 Time: 0.03584
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6422527 Time: 0.03318
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6750207 Time: 0.038528
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6815743 Time: 0.035924
[05/21/2021-07:42:05] [V] [TRT] Tactic: 6946815 Time: 0.04078
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7012351 Time: 0.036524
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7077887 Time: 0.03456
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7143423 Time: 0.048276
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7208959 Time: 0.034412
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7340031 Time: 0.036224
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7405567 Time: 0.03392
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7536639 Time: 0.04422
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7602175 Time: 0.034944
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7733247 Time: 0.034824
[05/21/2021-07:42:05] [V] [TRT] Tactic: 7798783 Time: 0.035584
[05/21/2021-07:42:05] [V] [TRT] Tactic: 8191999 Time: 0.037636
[05/21/2021-07:42:05] [V] [TRT] Tactic: 8257535 Time: 0.035712
[05/21/2021-07:42:05] [V] [TRT] Tactic: 8323071 Time: 0.03716
[05/21/2021-07:42:05] [V] [TRT] Tactic: 8650751 Time: 0.037376
[05/21/2021-07:42:06] [V] [TRT] Tactic: 8716287 Time: 0.037652
[05/21/2021-07:42:06] [V] [TRT] Tactic: 9109503 Time: 0.036992
[05/21/2021-07:42:06] [V] [TRT] Tactic: 9568255 Time: 0.035096
[05/21/2021-07:42:06] [V] [TRT] Tactic: 9895935 Time: 0.036632
[05/21/2021-07:42:06] [V] [TRT] Tactic: 10223615 Time: 0.037376
[05/21/2021-07:42:06] [V] [TRT] Tactic: 10354687 Time: 0.036096
[05/21/2021-07:42:06] [V] [TRT] Tactic: 10551295 Time: 0.04352
[05/21/2021-07:42:06] [V] [TRT] Tactic: 10747903 Time: 0.035076
[05/21/2021-07:42:06] [V] [TRT] Tactic: 10944511 Time: 0.035584
[05/21/2021-07:42:06] [V] [TRT] Fastest Tactic: 5242879 Time: 0.03308
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:06] [V] [TRT] Tactic: 0 Time: 0.01856
[05/21/2021-07:42:06] [V] [TRT] Tactic: 1 Time: 0.01856
[05/21/2021-07:42:06] [V] [TRT] Tactic: 2 Time: 0.044568
[05/21/2021-07:42:06] [V] [TRT] Tactic: 4 Time: 1.36079
[05/21/2021-07:42:06] [V] [TRT] Tactic: 5 Time: 0.04634
[05/21/2021-07:42:06] [V] [TRT] Tactic: 56 Time: 0.01792
[05/21/2021-07:42:06] [V] [TRT] Tactic: 57 Time: 0.017812
[05/21/2021-07:42:06] [V] [TRT] Tactic: 58 Time: 0.035992
[05/21/2021-07:42:06] [V] [TRT] Tactic: 60 Time: 1.36497
[05/21/2021-07:42:06] [V] [TRT] Tactic: 61 Time: 0.045516
[05/21/2021-07:42:06] [V] [TRT] Tactic: 112 Time: 0.019084
[05/21/2021-07:42:06] [V] [TRT] Tactic: 113 Time: 0.018388
[05/21/2021-07:42:06] [V] [TRT] Tactic: 114 Time: 0.045264
[05/21/2021-07:42:06] [V] [TRT] Tactic: 116 Time: 1.36122
[05/21/2021-07:42:06] [V] [TRT] Tactic: 117 Time: 0.04542
[05/21/2021-07:42:06] [V] [TRT] Fastest Tactic: 57 Time: 0.017812
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:06] [V] [TRT] Tactic: 4549827808004681195 Time: 0.016992
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:06] [V] [TRT] Tactic: 5779835512569528575 Time: 0.016512
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:06] [V] [TRT] Tactic: 9151672657204310840 Time: 0.027904
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:06] [V] [TRT] Tactic: -7491730084094677098 Time: 0.017716
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:06] [V] [TRT] Tactic: -6622064180404051845 Time: 0.027136
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:06] [V] [TRT] Tactic: -6313876406580483184 Time: 0.018268
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:06] [V] [TRT] Tactic: -6273689210331812572 Time: 0.016128
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:06] [V] [TRT] Tactic: -4337126844824617177 Time: 0.015376
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:06] [V] [TRT] Tactic: -1123676555321336786 Time: 0.01536
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:06] [V] [TRT] Tactic: -701551393537224327 Time: 0.016508
[05/21/2021-07:42:06] [V] [TRT] Fastest Tactic: -1123676555321336786 Time: 0.01536
[05/21/2021-07:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1123676555321336786
[05/21/2021-07:42:06] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:06] [V] [TRT] Tactic: 1663866669559596164 Time: 0.014336
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:06] [V] [TRT] Tactic: 2860655430572478466 Time: 0.016896
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:06] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017536
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:06] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017268
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:06] [V] [TRT] Tactic: 4696204239951173149 Time: 0.016692
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:06] [V] [TRT] Tactic: 5778138195697110003 Time: 0.015616
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:06] [V] [TRT] Tactic: 8918020581761223752 Time: 0.014852
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:06] [V] [TRT] Tactic: -5905193483742532701 Time: 0.015516
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:06] [V] [TRT] Tactic: -4035591156787122265 Time: 0.017064
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:06] [V] [TRT] Tactic: -2809379259463049391 Time: 0.014352
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:06] [V] [TRT] Tactic: -1985235291706575900 Time: 0.013568
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:06] [V] [TRT] Tactic: -504296718212024303 Time: 0.015232
[05/21/2021-07:42:06] [V] [TRT] Fastest Tactic: -1985235291706575900 Time: 0.013568
[05/21/2021-07:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1985235291706575900
[05/21/2021-07:42:06] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:06] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:06] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:07] [V] [TRT] Tactic: 1373022415249282411 Time: 0.017968
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:07] [V] [TRT] Tactic: 1663866669559596164 Time: 0.01536
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:07] [V] [TRT] Tactic: 2860655430572478466 Time: 0.016524
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:07] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017408
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:07] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01728
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:07] [V] [TRT] Tactic: 4696204239951173149 Time: 0.016772
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:07] [V] [TRT] Tactic: 5778138195697110003 Time: 0.014728
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:07] [V] [TRT] Tactic: 8918020581761223752 Time: 0.013836
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:07] [V] [TRT] Tactic: -7067026478815706014 Time: 0.011776
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:07] [V] [TRT] Tactic: -5905193483742532701 Time: 0.015744
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:07] [V] [TRT] Tactic: -4035591156787122265 Time: 0.01728
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:07] [V] [TRT] Tactic: -2809379259463049391 Time: 0.015648
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:07] [V] [TRT] Tactic: -1985235291706575900 Time: 0.015016
[05/21/2021-07:42:07] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:07] [V] [TRT] Tactic: -504296718212024303 Time: 0.015104
[05/21/2021-07:42:07] [V] [TRT] Fastest Tactic: -7067026478815706014 Time: 0.011776
[05/21/2021-07:42:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7067026478815706014
[05/21/2021-07:42:07] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:07] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:07] [V] [TRT] Tactic: 0 Time: 0.016384
[05/21/2021-07:42:07] [V] [TRT] Tactic: 1 Time: 0.01642
[05/21/2021-07:42:07] [V] [TRT] Tactic: 2 Time: 0.033792
[05/21/2021-07:42:07] [V] [TRT] Tactic: 4 Time: 1.36174
[05/21/2021-07:42:07] [V] [TRT] Tactic: 5 Time: 0.045916
[05/21/2021-07:42:07] [V] [TRT] Tactic: 56 Time: 0.016404
[05/21/2021-07:42:07] [V] [TRT] Tactic: 58 Time: 0.033804
[05/21/2021-07:42:07] [V] [TRT] Tactic: 60 Time: 1.36374
[05/21/2021-07:42:07] [V] [TRT] Tactic: 61 Time: 0.043832
[05/21/2021-07:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.016384
[05/21/2021-07:42:07] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:07] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:42:07] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:07] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:07] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:07] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:42:07] [V] [TRT] Tactic: 589823 Time: 0.022656
[05/21/2021-07:42:08] [V] [TRT] Tactic: 655359 Time: 0.021504
[05/21/2021-07:42:08] [V] [TRT] Tactic: 786431 Time: 0.021632
[05/21/2021-07:42:08] [V] [TRT] Tactic: 851967 Time: 0.021136
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1179647 Time: 0.020736
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1310719 Time: 0.020452
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1376255 Time: 0.021504
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1441791 Time: 0.019468
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1507327 Time: 0.020856
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1638399 Time: 0.020492
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1835007 Time: 0.021888
[05/21/2021-07:42:08] [V] [TRT] Tactic: 1900543 Time: 0.023332
[05/21/2021-07:42:08] [V] [TRT] Tactic: 2097151 Time: 0.021376
[05/21/2021-07:42:08] [V] [TRT] Tactic: 2162687 Time: 0.021724
[05/21/2021-07:42:08] [V] [TRT] Tactic: 2293759 Time: 0.021892
[05/21/2021-07:42:08] [V] [TRT] Tactic: 2359295 Time: 0.019852
[05/21/2021-07:42:08] [V] [TRT] Tactic: 2686975 Time: 0.020552
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3080191 Time: 0.019456
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3342335 Time: 0.02048
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3407871 Time: 0.019456
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3538943 Time: 0.019328
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3670015 Time: 0.026368
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3932159 Time: 0.02176
[05/21/2021-07:42:08] [V] [TRT] Tactic: 3997695 Time: 0.021076
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4063231 Time: 0.021424
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4194303 Time: 0.020356
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4259839 Time: 0.020224
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4325375 Time: 0.019976
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4521983 Time: 0.021944
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4587519 Time: 0.019464
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4653055 Time: 0.020224
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4915199 Time: 0.019792
[05/21/2021-07:42:08] [V] [TRT] Tactic: 4980735 Time: 0.02026
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5177343 Time: 0.02104
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5242879 Time: 0.0192
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5373951 Time: 0.022684
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5439487 Time: 0.023588
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5570559 Time: 0.020224
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5636095 Time: 0.021376
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5701631 Time: 0.02048
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5767167 Time: 0.03776
[05/21/2021-07:42:08] [V] [TRT] Tactic: 5832703 Time: 0.018432
[05/21/2021-07:42:09] [V] [TRT] Tactic: 5898239 Time: 0.02004
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6029311 Time: 0.0195
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6225919 Time: 0.019072
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6291455 Time: 0.01984
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6422527 Time: 0.019712
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6750207 Time: 0.022144
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6815743 Time: 0.020096
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6946815 Time: 0.023808
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7012351 Time: 0.021376
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7077887 Time: 0.018856
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7143423 Time: 0.027392
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7208959 Time: 0.019264
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7340031 Time: 0.020608
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7405567 Time: 0.020096
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7536639 Time: 0.025396
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7602175 Time: 0.020516
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7733247 Time: 0.019508
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7798783 Time: 0.021544
[05/21/2021-07:42:09] [V] [TRT] Tactic: 8191999 Time: 0.02112
[05/21/2021-07:42:09] [V] [TRT] Tactic: 8257535 Time: 0.020376
[05/21/2021-07:42:09] [V] [TRT] Tactic: 8323071 Time: 0.020864
[05/21/2021-07:42:09] [V] [TRT] Tactic: 8650751 Time: 0.020968
[05/21/2021-07:42:09] [V] [TRT] Tactic: 8716287 Time: 0.020608
[05/21/2021-07:42:09] [V] [TRT] Tactic: 9109503 Time: 0.02112
[05/21/2021-07:42:09] [V] [TRT] Tactic: 9568255 Time: 0.019456
[05/21/2021-07:42:09] [V] [TRT] Tactic: 9895935 Time: 0.020448
[05/21/2021-07:42:09] [V] [TRT] Tactic: 10223615 Time: 0.021632
[05/21/2021-07:42:09] [V] [TRT] Tactic: 10354687 Time: 0.019608
[05/21/2021-07:42:09] [V] [TRT] Tactic: 10551295 Time: 0.025392
[05/21/2021-07:42:09] [V] [TRT] Tactic: 10747903 Time: 0.01922
[05/21/2021-07:42:09] [V] [TRT] Tactic: 10944511 Time: 0.02024
[05/21/2021-07:42:09] [V] [TRT] Fastest Tactic: 5832703 Time: 0.018432
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:09] [V] [TRT] Tactic: 2195670545862694453 Time: 0.012452
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:09] [V] [TRT] Tactic: 3891805945559659536 Time: 0.01216
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:09] [V] [TRT] Tactic: 4418200634486186714 Time: 0.012048
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:09] [V] [TRT] Tactic: 5548126322150286555 Time: 0.012332
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:09] [V] [TRT] Tactic: 6057304366605292508 Time: 0.011904
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:09] [V] [TRT] Tactic: 7392644644614664811 Time: 0.011768
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:09] [V] [TRT] Tactic: -4884039206922900293 Time: 0.011264
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:09] [V] [TRT] Tactic: -4374269919094467161 Time: 0.011832
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:09] [V] [TRT] Tactic: -1546027692247304867 Time: 0.01208
[05/21/2021-07:42:09] [V] [TRT] Fastest Tactic: -4884039206922900293 Time: 0.011264
[05/21/2021-07:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4884039206922900293
[05/21/2021-07:42:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:09] [V] [TRT] Tactic: 0 Time: 0.022416
[05/21/2021-07:42:09] [V] [TRT] Tactic: 1 Time: 0.022656
[05/21/2021-07:42:09] [V] [TRT] Tactic: 2 Time: 0.041088
[05/21/2021-07:42:09] [V] [TRT] Tactic: 56 Time: 0.022736
[05/21/2021-07:42:09] [V] [TRT] Tactic: 58 Time: 0.040984
[05/21/2021-07:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.022416
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:09] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:09] [V] [TRT] Tactic: 254850674756030979 Time: 0.010548
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:09] [V] [TRT] Tactic: 1156328698016730421 Time: 0.008744
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:09] [V] [TRT] Tactic: 1362727228442059924 Time: 0.008192
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:09] [V] [TRT] Tactic: 1576319725282257846 Time: 0.010528
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:09] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01024
[05/21/2021-07:42:09] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:10] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011288
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:10] [V] [TRT] Tactic: 1899296423087490472 Time: 0.012464
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:10] [V] [TRT] Tactic: 2238656696610018305 Time: 0.011132
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:10] [V] [TRT] Tactic: 2541579301352125276 Time: 0.008428
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:10] [V] [TRT] Tactic: 2559328254295148085 Time: 0.010676
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:10] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01298
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:10] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011392
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012032
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010904
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3362537467505018070 Time: 0.00858
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3513075359009385578 Time: 0.010744
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3704534001553878387 Time: 0.008448
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:42:10] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009472
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009452
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0094
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008576
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4491683531415781597 Time: 0.009344
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4528997467275241200 Time: 0.008704
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4571819373777460444 Time: 0.010452
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4595173549602041350 Time: 0.01058
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4802447371470387646 Time: 0.009344
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:42:10] [V] [TRT] Tactic: 4993757826442493905 Time: 0.009376
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:10] [V] [TRT] Tactic: 5059676457552313631 Time: 0.01046
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:10] [V] [TRT] Tactic: 5205510332404400949 Time: 0.008448
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:10] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0098
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:10] [V] [TRT] Tactic: 5398999388616959893 Time: 0.009088
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:10] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009864
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:10] [V] [TRT] Tactic: 6377497238381488891 Time: 0.008184
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:10] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011264
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:42:10] [V] [TRT] Tactic: 6697277555581639516 Time: 0.008452
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:10] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010908
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:10] [V] [TRT] Tactic: 7216571380637776659 Time: 0.008832
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:10] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010624
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:10] [V] [TRT] Tactic: 8101703987960976805 Time: 0.012808
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:10] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011264
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:10] [V] [TRT] Tactic: 8764780417487154889 Time: 0.00918
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:42:10] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010168
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:10] [V] [TRT] Tactic: 8839784824303350101 Time: 0.008448
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:42:10] [V] [TRT] Tactic: -9203179519031456182 Time: 0.009344
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:10] [V] [TRT] Tactic: -9009272790678027912 Time: 0.009412
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:10] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011776
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:10] [V] [TRT] Tactic: -8280443484414412687 Time: 0.010392
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:10] [V] [TRT] Tactic: -8205952393017864204 Time: 0.010924
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:10] [V] [TRT] Tactic: -8131857373260504832 Time: 0.01014
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:10] [V] [TRT] Tactic: -7410012245391920273 Time: 0.012288
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:10] [V] [TRT] Tactic: -7099920365135295801 Time: 0.00872
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:10] [V] [TRT] Tactic: -7089118800560870395 Time: 0.01024
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:42:10] [V] [TRT] Tactic: -6768327495007644783 Time: 0.007424
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:10] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01352
[05/21/2021-07:42:10] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:11] [V] [TRT] Tactic: -6063766379489217211 Time: 0.010624
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:11] [V] [TRT] Tactic: -5530886555766748586 Time: 0.008832
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:11] [V] [TRT] Tactic: -5409588854490562130 Time: 0.009216
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:11] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011264
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:11] [V] [TRT] Tactic: -5127240325355316006 Time: 0.009984
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01024
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011316
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4548822885169694805 Time: 0.012088
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010256
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4293222705763522367 Time: 0.01024
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4152066959007262150 Time: 0.010548
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:11] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009928
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011532
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3905653247016903130 Time: 0.009216
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3903342530518878192 Time: 0.008176
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3864869056275745423 Time: 0.008348
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010916
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011392
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:11] [V] [TRT] Tactic: -2878731503146438856 Time: 0.009632
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:11] [V] [TRT] Tactic: -2602982885923184927 Time: 0.00834
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:11] [V] [TRT] Tactic: -2353603993968373338 Time: 0.009216
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:11] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011148
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:11] [V] [TRT] Tactic: -2003055242756584050 Time: 0.009432
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1985778916402815946 Time: 0.009216
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1828674067637788567 Time: 0.01226
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011252
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1562548049711204899 Time: 0.009264
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009268
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0113
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:11] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009856
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:11] [V] [TRT] Tactic: -406984317033388136 Time: 0.008576
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:11] [V] [TRT] Tactic: -331499326992534460 Time: 0.009252
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:42:11] [V] [TRT] Tactic: -206523504474952360 Time: 0.00832
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: -6768327495007644783 Time: 0.007424
[05/21/2021-07:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6768327495007644783
[05/21/2021-07:42:11] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: stage1_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:42:11] [V] [TRT] Tactic: 162720039126739803 Time: 0.007348
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:42:11] [V] [TRT] Tactic: 382577144988222004 Time: 0.00712
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:11] [V] [TRT] Tactic: 2334614616543277495 Time: 0.007296
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:11] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008364
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:42:11] [V] [TRT] Tactic: 6466136707377588846 Time: 0.01002
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:42:11] [V] [TRT] Tactic: 6958123061428231366 Time: 0.008496
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:11] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008216
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:42:11] [V] [TRT] Tactic: -7023377647582255231 Time: 0.008064
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:11] [V] [TRT] Tactic: -6148657501329441429 Time: 0.008704
[05/21/2021-07:42:11] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:11] [V] [TRT] Tactic: -3396930063803107917 Time: 0.009932
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 382577144988222004 Time: 0.00712
[05/21/2021-07:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 382577144988222004
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.01488
[05/21/2021-07:42:11] [V] [TRT] Tactic: 0 Time: 0.0164
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.01488
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.013732
[05/21/2021-07:42:11] [V] [TRT] Tactic: 0 Time: 0.015664
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.013732
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.014408
[05/21/2021-07:42:11] [V] [TRT] Tactic: 0 Time: 0.011484
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.011484
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.013684
[05/21/2021-07:42:11] [V] [TRT] Tactic: 0 Time: 0.009908
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.009908
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.012672
[05/21/2021-07:42:11] [V] [TRT] Tactic: 0 Time: 0.010784
[05/21/2021-07:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.010784
[05/21/2021-07:42:11] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:11] [V] [TRT] Tactic: 1002 Time: 0.012576
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.016512
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012576
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.018704
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.015488
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.015488
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.021612
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.012032
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.012032
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.014132
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.01512
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.014132
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.014348
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.01538
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.014348
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.012292
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.011508
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.011508
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.012188
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.011724
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.011724
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.015588
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.014048
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.014048
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.020864
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.010276
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.010276
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.013412
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.014632
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.015992
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.014632
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.01232
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.012416
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.01232
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.012168
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.012288
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012168
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.015872
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.011136
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.011136
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.013312
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.015916
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.013016
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.01616
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.013016
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.013952
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.007424
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.007424
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.01152
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.00768
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00768
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.010376
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.016012
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.010376
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.01702
[05/21/2021-07:42:12] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:12] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:12] [V] [TRT] Tactic: 1002 Time: 0.013952
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.012336
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.012336
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.013696
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.012696
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.012696
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.02048
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.007732
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.007732
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.0127
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.006528
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006528
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.012272
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.01152
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.01152
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.014496
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.008196
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.008196
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.011748
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.011272
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.011272
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.01214
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.01856
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.006144
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.01242
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.005284
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.005284
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.010496
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.0119
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.010496
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.014592
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.014396
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.014396
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.011816
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.011264
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.011264
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.01186
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.01216
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.01186
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.018432
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.013696
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.013696
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.012848
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.013992
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.012848
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1002 Time: 0.010668
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.011264
[05/21/2021-07:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.010668
[05/21/2021-07:42:13] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudaDepthwiseConvolution)
[05/21/2021-07:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (FusedConvActConvolution)
[05/21/2021-07:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:13] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:13] [V] [TRT] Tactic: 0 Time: 0.02624
[05/21/2021-07:42:13] [V] [TRT] Tactic: 1 Time: 0.026112
[05/21/2021-07:42:13] [V] [TRT] Tactic: 2 Time: 0.054928
[05/21/2021-07:42:13] [V] [TRT] Tactic: 4 Time: 1.36981
[05/21/2021-07:42:13] [V] [TRT] Tactic: 5 Time: 0.053976
[05/21/2021-07:42:13] [V] [TRT] Tactic: 56 Time: 0.026368
[05/21/2021-07:42:13] [V] [TRT] Tactic: 57 Time: 0.026404
[05/21/2021-07:42:13] [V] [TRT] Tactic: 58 Time: 0.054416
[05/21/2021-07:42:14] [V] [TRT] Tactic: 60 Time: 1.36828
[05/21/2021-07:42:14] [V] [TRT] Tactic: 61 Time: 0.055344
[05/21/2021-07:42:14] [V] [TRT] Tactic: 112 Time: 0.025684
[05/21/2021-07:42:14] [V] [TRT] Tactic: 113 Time: 0.025828
[05/21/2021-07:42:14] [V] [TRT] Tactic: 114 Time: 0.054272
[05/21/2021-07:42:14] [V] [TRT] Tactic: 116 Time: 1.37036
[05/21/2021-07:42:14] [V] [TRT] Tactic: 117 Time: 0.055552
[05/21/2021-07:42:14] [V] [TRT] Fastest Tactic: 112 Time: 0.025684
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4549827808004681195 Time: 0.02048
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:14] [V] [TRT] Tactic: 5779835512569528575 Time: 0.019996
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:14] [V] [TRT] Tactic: 9151672657204310840 Time: 0.040204
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:14] [V] [TRT] Tactic: -7491730084094677098 Time: 0.022292
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:14] [V] [TRT] Tactic: -6622064180404051845 Time: 0.037248
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:14] [V] [TRT] Tactic: -6313876406580483184 Time: 0.02282
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:14] [V] [TRT] Tactic: -6273689210331812572 Time: 0.019584
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:14] [V] [TRT] Tactic: -4337126844824617177 Time: 0.018432
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:14] [V] [TRT] Tactic: -1123676555321336786 Time: 0.018452
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:14] [V] [TRT] Tactic: -701551393537224327 Time: 0.019728
[05/21/2021-07:42:14] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.018432
[05/21/2021-07:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[05/21/2021-07:42:14] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:14] [V] [TRT] Tactic: 1663866669559596164 Time: 0.021784
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:14] [V] [TRT] Tactic: 2860655430572478466 Time: 0.021164
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024832
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024364
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4696204239951173149 Time: 0.020736
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:14] [V] [TRT] Tactic: 5778138195697110003 Time: 0.022016
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:14] [V] [TRT] Tactic: 8918020581761223752 Time: 0.021504
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:14] [V] [TRT] Tactic: -5905193483742532701 Time: 0.019968
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:14] [V] [TRT] Tactic: -4035591156787122265 Time: 0.024144
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:14] [V] [TRT] Tactic: -2809379259463049391 Time: 0.021888
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:14] [V] [TRT] Tactic: -1985235291706575900 Time: 0.021376
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:14] [V] [TRT] Tactic: -504296718212024303 Time: 0.020736
[05/21/2021-07:42:14] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.019968
[05/21/2021-07:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701
[05/21/2021-07:42:14] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:14] [V] [TRT] Tactic: 1373022415249282411 Time: 0.01658
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:14] [V] [TRT] Tactic: 1663866669559596164 Time: 0.020608
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:14] [V] [TRT] Tactic: 2860655430572478466 Time: 0.01984
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02496
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4479823862704990365 Time: 0.02462
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:14] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02098
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:14] [V] [TRT] Tactic: 5778138195697110003 Time: 0.021768
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:14] [V] [TRT] Tactic: 8918020581761223752 Time: 0.021416
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:14] [V] [TRT] Tactic: -7067026478815706014 Time: 0.018304
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:14] [V] [TRT] Tactic: -5905193483742532701 Time: 0.020008
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:14] [V] [TRT] Tactic: -4035591156787122265 Time: 0.024192
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:14] [V] [TRT] Tactic: -2809379259463049391 Time: 0.021888
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:14] [V] [TRT] Tactic: -1985235291706575900 Time: 0.021248
[05/21/2021-07:42:14] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:14] [V] [TRT] Tactic: -504296718212024303 Time: 0.02048
[05/21/2021-07:42:14] [V] [TRT] Fastest Tactic: 1373022415249282411 Time: 0.01658
[05/21/2021-07:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1373022415249282411
[05/21/2021-07:42:14] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:14] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:14] [V] [TRT] Tactic: 0 Time: 0.020436
[05/21/2021-07:42:14] [V] [TRT] Tactic: 1 Time: 0.020352
[05/21/2021-07:42:14] [V] [TRT] Tactic: 2 Time: 0.03776
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4 Time: 1.37087
[05/21/2021-07:42:15] [V] [TRT] Tactic: 5 Time: 0.052352
[05/21/2021-07:42:15] [V] [TRT] Tactic: 56 Time: 0.021504
[05/21/2021-07:42:15] [V] [TRT] Tactic: 58 Time: 0.044544
[05/21/2021-07:42:15] [V] [TRT] Tactic: 60 Time: 1.36835
[05/21/2021-07:42:15] [V] [TRT] Tactic: 61 Time: 0.05264
[05/21/2021-07:42:15] [V] [TRT] Fastest Tactic: 1 Time: 0.020352
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:42:15] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (FusedConvActConvolution)
[05/21/2021-07:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2195670545862694453 Time: 0.013972
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3891805945559659536 Time: 0.013472
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4418200634486186714 Time: 0.013196
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:15] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01344
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:15] [V] [TRT] Tactic: 6057304366605292508 Time: 0.013472
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:15] [V] [TRT] Tactic: 7392644644614664811 Time: 0.012288
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:15] [V] [TRT] Tactic: -4884039206922900293 Time: 0.011356
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:15] [V] [TRT] Tactic: -4374269919094467161 Time: 0.012328
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:15] [V] [TRT] Tactic: -1546027692247304867 Time: 0.011456
[05/21/2021-07:42:15] [V] [TRT] Fastest Tactic: -4884039206922900293 Time: 0.011356
[05/21/2021-07:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4884039206922900293
[05/21/2021-07:42:15] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudaDepthwiseConvolution)
[05/21/2021-07:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:15] [V] [TRT] Tactic: 0 Time: 0.0297
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1 Time: 0.02884
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2 Time: 0.047784
[05/21/2021-07:42:15] [V] [TRT] Tactic: 56 Time: 0.028464
[05/21/2021-07:42:15] [V] [TRT] Tactic: 58 Time: 0.04736
[05/21/2021-07:42:15] [V] [TRT] Fastest Tactic: 56 Time: 0.028464
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:15] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:15] [V] [TRT] Tactic: 254850674756030979 Time: 0.012576
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01104
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1362727228442059924 Time: 0.01102
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1576319725282257846 Time: 0.013612
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1832046141070096030 Time: 0.013568
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1838082074606840426 Time: 0.013864
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:15] [V] [TRT] Tactic: 1899296423087490472 Time: 0.015896
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2238656696610018305 Time: 0.013548
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2541579301352125276 Time: 0.010724
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2559328254295148085 Time: 0.010228
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0134
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:15] [V] [TRT] Tactic: 2968605903460894194 Time: 0.012084
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012548
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3359475309458902373 Time: 0.012948
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01094
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3513075359009385578 Time: 0.012408
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0112
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:42:15] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0117
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4278315135102886928 Time: 0.012112
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4370476717970497892 Time: 0.012572
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4480294673430783793 Time: 0.011928
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01186
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01088
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4571819373777460444 Time: 0.011264
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4595173549602041350 Time: 0.010112
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:15] [V] [TRT] Tactic: 4802447371470387646 Time: 0.00956
[05/21/2021-07:42:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:42:16] [V] [TRT] Tactic: 4993757826442493905 Time: 0.012184
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:16] [V] [TRT] Tactic: 5059676457552313631 Time: 0.012824
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:16] [V] [TRT] Tactic: 5205510332404400949 Time: 0.010624
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:16] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011008
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:16] [V] [TRT] Tactic: 5398999388616959893 Time: 0.011276
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:16] [V] [TRT] Tactic: 6034364043891107501 Time: 0.011372
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:16] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011012
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:16] [V] [TRT] Tactic: 6468794451065529747 Time: 0.014592
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:42:16] [V] [TRT] Tactic: 6697277555581639516 Time: 0.01216
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:16] [V] [TRT] Tactic: 6859477213531075460 Time: 0.013952
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:16] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0113
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:16] [V] [TRT] Tactic: 7609923741161019135 Time: 0.013484
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:16] [V] [TRT] Tactic: 8101703987960976805 Time: 0.013588
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:16] [V] [TRT] Tactic: 8170606396342855895 Time: 0.012288
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:16] [V] [TRT] Tactic: 8764780417487154889 Time: 0.009248
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:42:16] [V] [TRT] Tactic: 8823554289762712606 Time: 0.01024
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:16] [V] [TRT] Tactic: 8839784824303350101 Time: 0.011392
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:42:16] [V] [TRT] Tactic: -9203179519031456182 Time: 0.010496
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:16] [V] [TRT] Tactic: -9009272790678027912 Time: 0.011152
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:16] [V] [TRT] Tactic: -8604374562669615024 Time: 0.014472
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:16] [V] [TRT] Tactic: -8280443484414412687 Time: 0.012464
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:16] [V] [TRT] Tactic: -8205952393017864204 Time: 0.012052
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:16] [V] [TRT] Tactic: -8131857373260504832 Time: 0.012288
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:16] [V] [TRT] Tactic: -7410012245391920273 Time: 0.015872
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:16] [V] [TRT] Tactic: -7099920365135295801 Time: 0.011544
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:16] [V] [TRT] Tactic: -7089118800560870395 Time: 0.01344
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:42:16] [V] [TRT] Tactic: -6768327495007644783 Time: 0.00832
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:16] [V] [TRT] Tactic: -6356316196810535311 Time: 0.014336
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:16] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011264
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:16] [V] [TRT] Tactic: -5530886555766748586 Time: 0.009472
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:16] [V] [TRT] Tactic: -5409588854490562130 Time: 0.010524
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:16] [V] [TRT] Tactic: -5161596964442251102 Time: 0.013664
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:16] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01142
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4950923835688973492 Time: 0.011544
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4796511246675321840 Time: 0.014028
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4548822885169694805 Time: 0.015488
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4379519430184503304 Time: 0.012788
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4293222705763522367 Time: 0.012928
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0127
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:16] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011972
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3987638434926559037 Time: 0.014468
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01152
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3903342530518878192 Time: 0.01106
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3864869056275745423 Time: 0.009244
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011264
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:16] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011392
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:16] [V] [TRT] Tactic: -2878731503146438856 Time: 0.008852
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:16] [V] [TRT] Tactic: -2602982885923184927 Time: 0.010752
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:16] [V] [TRT] Tactic: -2353603993968373338 Time: 0.011064
[05/21/2021-07:42:16] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:17] [V] [TRT] Tactic: -2032577876140256150 Time: 0.014148
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:17] [V] [TRT] Tactic: -2003055242756584050 Time: 0.011136
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01146
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1828674067637788567 Time: 0.01536
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1640527254204634147 Time: 0.013696
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1562548049711204899 Time: 0.010684
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1242202084391243207 Time: 0.01142
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1099247066487349374 Time: 0.013952
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:17] [V] [TRT] Tactic: -1038291877007553549 Time: 0.010252
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:17] [V] [TRT] Tactic: -406984317033388136 Time: 0.008948
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:17] [V] [TRT] Tactic: -331499326992534460 Time: 0.01024
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:42:17] [V] [TRT] Tactic: -206523504474952360 Time: 0.008844
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: -6768327495007644783 Time: 0.00832
[05/21/2021-07:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6768327495007644783
[05/21/2021-07:42:17] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CudnnConvolution)
[05/21/2021-07:42:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CublasConvolution)
[05/21/2021-07:42:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: stage1_unit1_sc + _plus0 (CaskConvolution)
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:42:17] [V] [TRT] Tactic: 162720039126739803 Time: 0.010688
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:42:17] [V] [TRT] Tactic: 382577144988222004 Time: 0.010496
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:17] [V] [TRT] Tactic: 2334614616543277495 Time: 0.01088
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:17] [V] [TRT] Tactic: 4126996489741716394 Time: 0.010796
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:42:17] [V] [TRT] Tactic: 6466136707377588846 Time: 0.011264
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:42:17] [V] [TRT] Tactic: 6958123061428231366 Time: 0.011392
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:17] [V] [TRT] Tactic: 8940522081427638481 Time: 0.01088
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:42:17] [V] [TRT] Tactic: -7023377647582255231 Time: 0.010712
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:17] [V] [TRT] Tactic: -6148657501329441429 Time: 0.009216
[05/21/2021-07:42:17] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:17] [V] [TRT] Tactic: -3396930063803107917 Time: 0.009892
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: -6148657501329441429 Time: 0.009216
[05/21/2021-07:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6148657501329441429
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.013344
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.016692
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.013344
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.014712
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.01554
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.014712
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.016048
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.013456
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.013456
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.014592
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.009728
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009728
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.012544
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.01088
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.01088
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:17] [V] [TRT] Tactic: 1002 Time: 0.012672
[05/21/2021-07:42:17] [V] [TRT] Tactic: 0 Time: 0.016228
[05/21/2021-07:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.012672
[05/21/2021-07:42:17] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.01844
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015516
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.015516
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.021676
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.011092
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011092
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.013452
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.013712
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.009648
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.009452
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009452
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(802816,1,14336,256) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012168
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.01156
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.01156
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.018528
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015544
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.015544
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.021596
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.012068
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.012068
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.01408
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015252
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.01408
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.014492
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015532
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.014492
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1:4,3584,64) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.012372
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.016
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.011264
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011264
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.0114
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015336
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015416
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.014208
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.007964
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007964
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.01152
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.007552
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007552
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(802816,3136,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.011392
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.015764
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.011392
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.016896
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.008632
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.008632
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.013824
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.012416
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.012416
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.01358
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.0128
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0128
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.021592
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.007596
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.007596
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.006528
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.006528
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136:2,56,1) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012544
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.011392
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011392
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.012984
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.006144
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.010112
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.009872
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009872
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.009728
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.011172
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.009728
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.018816
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.006144
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.013056
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.005988
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005988
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,1:8,1792,32) -> Half(50176,1:16,896,16) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.010904
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.011264
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.010904
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.0145
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.014208
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.014208
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(802816,1,14336,256) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.011656
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.01128
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.01128
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Float(200704,1:4,3584,64) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.011964
[05/21/2021-07:42:18] [V] [TRT] Tactic: 0 Time: 0.012288
[05/21/2021-07:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.011964
[05/21/2021-07:42:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(802816,3136,56,1) (Reformat)
[05/21/2021-07:42:18] [V] [TRT] Tactic: 1002 Time: 0.018548
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.013312
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.013312
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(401408,3136:2,56,1) (Reformat)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.013292
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:16,896,16) -> Half(100352,1:8,1792,32) (Reformat)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1002 Time: 0.009472
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.010264
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.009472
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.011008
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.011008
[05/21/2021-07:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.00784
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00784
[05/21/2021-07:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 0 Time: 0.008832
[05/21/2021-07:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.008832
[05/21/2021-07:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_bn1 + stage1_unit2_relu1 (Scale)
[05/21/2021-07:42:19] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:19] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:42:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:19] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:19] [V] [TRT] Tactic: 589823 Time: 0.100736
[05/21/2021-07:42:19] [V] [TRT] Tactic: 655359 Time: 0.06134
[05/21/2021-07:42:19] [V] [TRT] Tactic: 786431 Time: 0.029196
[05/21/2021-07:42:19] [V] [TRT] Tactic: 851967 Time: 0.034
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1179647 Time: 0.02048
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1310719 Time: 0.04416
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1376255 Time: 0.068096
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1441791 Time: 0.028672
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1507327 Time: 0.038672
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1638399 Time: 0.020496
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1835007 Time: 0.026624
[05/21/2021-07:42:19] [V] [TRT] Tactic: 1900543 Time: 0.043264
[05/21/2021-07:42:19] [V] [TRT] Tactic: 2097151 Time: 0.020496
[05/21/2021-07:42:19] [V] [TRT] Tactic: 2162687 Time: 0.04624
[05/21/2021-07:42:19] [V] [TRT] Tactic: 2293759 Time: 0.044032
[05/21/2021-07:42:19] [V] [TRT] Tactic: 2359295 Time: 0.029076
[05/21/2021-07:42:19] [V] [TRT] Tactic: 2686975 Time: 0.0441
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3080191 Time: 0.036608
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3342335 Time: 0.039536
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3407871 Time: 0.038704
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3538943 Time: 0.026512
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3670015 Time: 0.114568
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3932159 Time: 0.05888
[05/21/2021-07:42:19] [V] [TRT] Tactic: 3997695 Time: 0.023296
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4063231 Time: 0.0261
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4194303 Time: 0.029824
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4259839 Time: 0.02282
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4325375 Time: 0.026796
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4521983 Time: 0.064544
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4587519 Time: 0.022532
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4653055 Time: 0.019328
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4915199 Time: 0.02048
[05/21/2021-07:42:19] [V] [TRT] Tactic: 4980735 Time: 0.0277
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5177343 Time: 0.018616
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5242879 Time: 0.026624
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5373951 Time: 0.022528
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5439487 Time: 0.031168
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5570559 Time: 0.02884
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5636095 Time: 0.026512
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5701631 Time: 0.063744
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5767167 Time: 0.05952
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5832703 Time: 0.038148
[05/21/2021-07:42:19] [V] [TRT] Tactic: 5898239 Time: 0.020648
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6029311 Time: 0.062088
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6225919 Time: 0.025864
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6291455 Time: 0.02048
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6422527 Time: 0.036376
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6750207 Time: 0.023848
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6815743 Time: 0.040496
[05/21/2021-07:42:19] [V] [TRT] Tactic: 6946815 Time: 0.031488
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7012351 Time: 0.022924
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7077887 Time: 0.026148
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7143423 Time: 0.039416
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7208959 Time: 0.038952
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7340031 Time: 0.02126
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7405567 Time: 0.025052
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7536639 Time: 0.038912
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7602175 Time: 0.02176
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7733247 Time: 0.021504
[05/21/2021-07:42:20] [V] [TRT] Tactic: 7798783 Time: 0.025088
[05/21/2021-07:42:20] [V] [TRT] Tactic: 8191999 Time: 0.02438
[05/21/2021-07:42:20] [V] [TRT] Tactic: 8257535 Time: 0.02048
[05/21/2021-07:42:20] [V] [TRT] Tactic: 8323071 Time: 0.024928
[05/21/2021-07:42:20] [V] [TRT] Tactic: 8650751 Time: 0.024736
[05/21/2021-07:42:20] [V] [TRT] Tactic: 8716287 Time: 0.027984
[05/21/2021-07:42:20] [V] [TRT] Tactic: 9109503 Time: 0.022824
[05/21/2021-07:42:20] [V] [TRT] Tactic: 9568255 Time: 0.022272
[05/21/2021-07:42:20] [V] [TRT] Tactic: 9895935 Time: 0.029708
[05/21/2021-07:42:20] [V] [TRT] Tactic: 10223615 Time: 0.0652
[05/21/2021-07:42:20] [V] [TRT] Tactic: 10354687 Time: 0.021884
[05/21/2021-07:42:20] [V] [TRT] Tactic: 10551295 Time: 0.040064
[05/21/2021-07:42:20] [V] [TRT] Tactic: 10747903 Time: 0.026752
[05/21/2021-07:42:20] [V] [TRT] Tactic: 10944511 Time: 0.038528
[05/21/2021-07:42:20] [V] [TRT] Fastest Tactic: 5177343 Time: 0.018616
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:20] [V] [TRT] Tactic: 0 Time: 0.0288
[05/21/2021-07:42:20] [V] [TRT] Tactic: 1 Time: 0.026496
[05/21/2021-07:42:20] [V] [TRT] Tactic: 2 Time: 0.132352
[05/21/2021-07:42:20] [V] [TRT] Tactic: 4 Time: 1.36941
[05/21/2021-07:42:20] [V] [TRT] Tactic: 5 Time: 0.067916
[05/21/2021-07:42:20] [V] [TRT] Tactic: 56 Time: 0.0288
[05/21/2021-07:42:20] [V] [TRT] Tactic: 57 Time: 0.026152
[05/21/2021-07:42:20] [V] [TRT] Tactic: 58 Time: 0.130992
[05/21/2021-07:42:20] [V] [TRT] Tactic: 60 Time: 1.37419
[05/21/2021-07:42:20] [V] [TRT] Tactic: 61 Time: 0.0672
[05/21/2021-07:42:20] [V] [TRT] Tactic: 112 Time: 0.024144
[05/21/2021-07:42:20] [V] [TRT] Tactic: 113 Time: 0.02422
[05/21/2021-07:42:20] [V] [TRT] Tactic: 114 Time: 0.129068
[05/21/2021-07:42:20] [V] [TRT] Tactic: 116 Time: 1.36883
[05/21/2021-07:42:20] [V] [TRT] Tactic: 117 Time: 0.068364
[05/21/2021-07:42:20] [V] [TRT] Fastest Tactic: 112 Time: 0.024144
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:20] [V] [TRT] Tactic: 4549827808004681195 Time: 0.031104
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:20] [V] [TRT] Tactic: 5779835512569528575 Time: 0.036276
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:20] [V] [TRT] Tactic: 9151672657204310840 Time: 0.055168
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:20] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0456
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:20] [V] [TRT] Tactic: -6622064180404051845 Time: 0.052864
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:20] [V] [TRT] Tactic: -6313876406580483184 Time: 0.04724
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:20] [V] [TRT] Tactic: -6273689210331812572 Time: 0.036104
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:20] [V] [TRT] Tactic: -4337126844824617177 Time: 0.029084
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:20] [V] [TRT] Tactic: -1123676555321336786 Time: 0.035204
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:20] [V] [TRT] Tactic: -701551393537224327 Time: 0.029952
[05/21/2021-07:42:20] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.029084
[05/21/2021-07:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343
[05/21/2021-07:42:20] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:20] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:20] [V] [TRT] Tactic: 1663866669559596164 Time: 0.038296
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:20] [V] [TRT] Tactic: 2860655430572478466 Time: 0.02428
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:20] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017048
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:20] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016896
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:20] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0241
[05/21/2021-07:42:20] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:21] [V] [TRT] Tactic: 5778138195697110003 Time: 0.038624
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:21] [V] [TRT] Tactic: 8918020581761223752 Time: 0.03572
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:21] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022348
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:21] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016792
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:21] [V] [TRT] Tactic: -2809379259463049391 Time: 0.034816
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:21] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033176
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:21] [V] [TRT] Tactic: -504296718212024303 Time: 0.033536
[05/21/2021-07:42:21] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.016792
[05/21/2021-07:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:42:21] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:21] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1373022415249282411 Time: 0.03072
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1663866669559596164 Time: 0.03796
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:21] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024192
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:21] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017188
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:21] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017116
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:21] [V] [TRT] Tactic: 4696204239951173149 Time: 0.023948
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:21] [V] [TRT] Tactic: 5778138195697110003 Time: 0.038452
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:21] [V] [TRT] Tactic: 8918020581761223752 Time: 0.035564
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:21] [V] [TRT] Tactic: -7067026478815706014 Time: 0.029868
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:21] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022268
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:21] [V] [TRT] Tactic: -4035591156787122265 Time: 0.015348
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:21] [V] [TRT] Tactic: -2809379259463049391 Time: 0.034808
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:21] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033
[05/21/2021-07:42:21] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:21] [V] [TRT] Tactic: -504296718212024303 Time: 0.035352
[05/21/2021-07:42:21] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.015348
[05/21/2021-07:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:42:21] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:21] [V] [TRT] Tactic: 0 Time: 0.0256
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1 Time: 0.026496
[05/21/2021-07:42:21] [V] [TRT] Tactic: 2 Time: 0.098432
[05/21/2021-07:42:21] [V] [TRT] Tactic: 4 Time: 1.37114
[05/21/2021-07:42:21] [V] [TRT] Tactic: 5 Time: 0.0677
[05/21/2021-07:42:21] [V] [TRT] Tactic: 56 Time: 0.025984
[05/21/2021-07:42:21] [V] [TRT] Tactic: 58 Time: 0.100608
[05/21/2021-07:42:21] [V] [TRT] Tactic: 60 Time: 1.37101
[05/21/2021-07:42:21] [V] [TRT] Tactic: 61 Time: 0.068124
[05/21/2021-07:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0256
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:42:21] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:21] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:42:21] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:21] [V] [TRT] Tactic: 589823 Time: 0.03406
[05/21/2021-07:42:21] [V] [TRT] Tactic: 655359 Time: 0.024632
[05/21/2021-07:42:21] [V] [TRT] Tactic: 786431 Time: 0.015828
[05/21/2021-07:42:21] [V] [TRT] Tactic: 851967 Time: 0.020096
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1179647 Time: 0.012292
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1310719 Time: 0.020496
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1376255 Time: 0.027904
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1441791 Time: 0.013568
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1507327 Time: 0.01834
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1638399 Time: 0.013376
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1835007 Time: 0.01642
[05/21/2021-07:42:21] [V] [TRT] Tactic: 1900543 Time: 0.02754
[05/21/2021-07:42:21] [V] [TRT] Tactic: 2097151 Time: 0.013584
[05/21/2021-07:42:21] [V] [TRT] Tactic: 2162687 Time: 0.02816
[05/21/2021-07:42:21] [V] [TRT] Tactic: 2293759 Time: 0.026672
[05/21/2021-07:42:22] [V] [TRT] Tactic: 2359295 Time: 0.018636
[05/21/2021-07:42:22] [V] [TRT] Tactic: 2686975 Time: 0.026644
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3080191 Time: 0.016532
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3342335 Time: 0.01848
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3407871 Time: 0.017288
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3538943 Time: 0.014336
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3670015 Time: 0.04444
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3932159 Time: 0.0224
[05/21/2021-07:42:22] [V] [TRT] Tactic: 3997695 Time: 0.013608
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4063231 Time: 0.01564
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4194303 Time: 0.014352
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4259839 Time: 0.013184
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4325375 Time: 0.013316
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4521983 Time: 0.025592
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4587519 Time: 0.013696
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4653055 Time: 0.013212
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4915199 Time: 0.013072
[05/21/2021-07:42:22] [V] [TRT] Tactic: 4980735 Time: 0.017024
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5177343 Time: 0.012928
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5242879 Time: 0.016896
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5373951 Time: 0.014564
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5439487 Time: 0.018452
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5570559 Time: 0.017832
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5636095 Time: 0.01592
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5701631 Time: 0.025472
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5767167 Time: 0.030868
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5832703 Time: 0.01668
[05/21/2021-07:42:22] [V] [TRT] Tactic: 5898239 Time: 0.013568
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6029311 Time: 0.02496
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6225919 Time: 0.01408
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6291455 Time: 0.012712
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6422527 Time: 0.016512
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6750207 Time: 0.01428
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6815743 Time: 0.018432
[05/21/2021-07:42:22] [V] [TRT] Tactic: 6946815 Time: 0.017408
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7012351 Time: 0.013312
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7077887 Time: 0.013312
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7143423 Time: 0.018688
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7208959 Time: 0.01728
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7340031 Time: 0.013184
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7405567 Time: 0.014208
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7536639 Time: 0.023076
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7602175 Time: 0.01478
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7733247 Time: 0.013604
[05/21/2021-07:42:22] [V] [TRT] Tactic: 7798783 Time: 0.016416
[05/21/2021-07:42:22] [V] [TRT] Tactic: 8191999 Time: 0.014592
[05/21/2021-07:42:22] [V] [TRT] Tactic: 8257535 Time: 0.013328
[05/21/2021-07:42:22] [V] [TRT] Tactic: 8323071 Time: 0.015488
[05/21/2021-07:42:22] [V] [TRT] Tactic: 8650751 Time: 0.015488
[05/21/2021-07:42:23] [V] [TRT] Tactic: 8716287 Time: 0.01536
[05/21/2021-07:42:23] [V] [TRT] Tactic: 9109503 Time: 0.01336
[05/21/2021-07:42:23] [V] [TRT] Tactic: 9568255 Time: 0.01264
[05/21/2021-07:42:23] [V] [TRT] Tactic: 9895935 Time: 0.014336
[05/21/2021-07:42:23] [V] [TRT] Tactic: 10223615 Time: 0.02628
[05/21/2021-07:42:23] [V] [TRT] Tactic: 10354687 Time: 0.013568
[05/21/2021-07:42:23] [V] [TRT] Tactic: 10551295 Time: 0.019368
[05/21/2021-07:42:23] [V] [TRT] Tactic: 10747903 Time: 0.01422
[05/21/2021-07:42:23] [V] [TRT] Tactic: 10944511 Time: 0.017192
[05/21/2021-07:42:23] [V] [TRT] Fastest Tactic: 1179647 Time: 0.012292
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2195670545862694453 Time: 0.019088
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3891805945559659536 Time: 0.02484
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:23] [V] [TRT] Tactic: 4418200634486186714 Time: 0.016768
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:23] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018048
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:23] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017716
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:23] [V] [TRT] Tactic: 7392644644614664811 Time: 0.016384
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:23] [V] [TRT] Tactic: -4884039206922900293 Time: 0.023568
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:23] [V] [TRT] Tactic: -4374269919094467161 Time: 0.016384
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:23] [V] [TRT] Tactic: -1546027692247304867 Time: 0.023936
[05/21/2021-07:42:23] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.016384
[05/21/2021-07:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647
[05/21/2021-07:42:23] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:42:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:23] [V] [TRT] Tactic: 0 Time: 0.035712
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1 Time: 0.03448
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2 Time: 0.107776
[05/21/2021-07:42:23] [V] [TRT] Tactic: 56 Time: 0.035444
[05/21/2021-07:42:23] [V] [TRT] Tactic: 58 Time: 0.109056
[05/21/2021-07:42:23] [V] [TRT] Fastest Tactic: 1 Time: 0.03448
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:23] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:23] [V] [TRT] Tactic: 254850674756030979 Time: 0.016652
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1156328698016730421 Time: 0.012088
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012672
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1576319725282257846 Time: 0.009216
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009216
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009216
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:23] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008708
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009472
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2541579301352125276 Time: 0.011416
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2559328254295148085 Time: 0.016336
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00862
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:23] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009356
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009268
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009472
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3362537467505018070 Time: 0.011612
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3513075359009385578 Time: 0.016812
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3704534001553878387 Time: 0.011396
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:42:23] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007208
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:23] [V] [TRT] Tactic: 4278315135102886928 Time: 0.008344
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:42:23] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008168
[05/21/2021-07:42:23] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008868
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4491683531415781597 Time: 0.016528
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01156
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4571819373777460444 Time: 0.016672
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016412
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4802447371470387646 Time: 0.012928
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:42:24] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00858
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:24] [V] [TRT] Tactic: 5059676457552313631 Time: 0.01664
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:24] [V] [TRT] Tactic: 5205510332404400949 Time: 0.010368
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:24] [V] [TRT] Tactic: 5346855796032465921 Time: 0.010996
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:24] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012288
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:24] [V] [TRT] Tactic: 6034364043891107501 Time: 0.008704
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:24] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011776
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:24] [V] [TRT] Tactic: 6468794451065529747 Time: 0.009748
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:42:24] [V] [TRT] Tactic: 6697277555581639516 Time: 0.008576
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:24] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008064
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:24] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013312
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:24] [V] [TRT] Tactic: 7609923741161019135 Time: 0.008576
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:24] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008344
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:24] [V] [TRT] Tactic: 8170606396342855895 Time: 0.009812
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:24] [V] [TRT] Tactic: 8764780417487154889 Time: 0.011904
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:42:24] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008336
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:24] [V] [TRT] Tactic: 8839784824303350101 Time: 0.012288
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:42:24] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007168
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:24] [V] [TRT] Tactic: -9009272790678027912 Time: 0.013696
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:24] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00832
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:24] [V] [TRT] Tactic: -8280443484414412687 Time: 0.016456
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:24] [V] [TRT] Tactic: -8205952393017864204 Time: 0.016412
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:24] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009244
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:24] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00842
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:24] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008576
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:24] [V] [TRT] Tactic: -7089118800560870395 Time: 0.007936
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:42:24] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01152
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:24] [V] [TRT] Tactic: -6356316196810535311 Time: 0.008756
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:24] [V] [TRT] Tactic: -6063766379489217211 Time: 0.00938
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:24] [V] [TRT] Tactic: -5530886555766748586 Time: 0.010532
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:24] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00708
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:24] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009768
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:24] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008704
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:24] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008064
[05/21/2021-07:42:24] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0096
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008192
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00888
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00768
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4152066959007262150 Time: 0.016376
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:25] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008216
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009204
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01228
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012928
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3864869056275745423 Time: 0.013056
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3601464762214218301 Time: 0.007604
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:25] [V] [TRT] Tactic: -3058330359340425555 Time: 0.009216
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:25] [V] [TRT] Tactic: -2878731503146438856 Time: 0.012032
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:25] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011392
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:25] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01268
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:25] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009524
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:25] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00852
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1985778916402815946 Time: 0.012288
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1828674067637788567 Time: 0.009204
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1640527254204634147 Time: 0.008576
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1562548049711204899 Time: 0.01232
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1242202084391243207 Time: 0.008872
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008004
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:25] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009104
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:25] [V] [TRT] Tactic: -406984317033388136 Time: 0.011316
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:25] [V] [TRT] Tactic: -331499326992534460 Time: 0.008576
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:42:25] [V] [TRT] Tactic: -206523504474952360 Time: 0.012288
[05/21/2021-07:42:25] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.00708
[05/21/2021-07:42:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[05/21/2021-07:42:25] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:42:25] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:25] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:25] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:25] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv1 + stage1_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:42:25] [V] [TRT] Tactic: 162720039126739803 Time: 0.006552
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:42:25] [V] [TRT] Tactic: 382577144988222004 Time: 0.007456
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 1466417369352598098
[05/21/2021-07:42:25] [V] [TRT] Tactic: 1466417369352598098 Time: 0.007376
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:25] [V] [TRT] Tactic: 2334614616543277495 Time: 0.009008
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 3635375317854598708
[05/21/2021-07:42:25] [V] [TRT] Tactic: 3635375317854598708 Time: 0.0077
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:25] [V] [TRT] Tactic: 4126996489741716394 Time: 0.0072
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:42:25] [V] [TRT] Tactic: 6197123388212233554 Time: 0.00846
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:42:25] [V] [TRT] Tactic: 6466136707377588846 Time: 0.00896
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:42:25] [V] [TRT] Tactic: 6958123061428231366 Time: 0.007696
[05/21/2021-07:42:25] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:26] [V] [TRT] Tactic: 8940522081427638481 Time: 0.007448
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:42:26] [V] [TRT] Tactic: -7023377647582255231 Time: 0.00626
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:42:26] [V] [TRT] Tactic: -6288137413706508928 Time: 0.008244
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:26] [V] [TRT] Tactic: -6148657501329441429 Time: 0.007156
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -3548326199661609828
[05/21/2021-07:42:26] [V] [TRT] Tactic: -3548326199661609828 Time: 0.007168
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:26] [V] [TRT] Tactic: -3396930063803107917 Time: 0.009088
[05/21/2021-07:42:26] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -2813185745402245055
[05/21/2021-07:42:26] [V] [TRT] Tactic: -2813185745402245055 Time: 0.007168
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: -7023377647582255231 Time: 0.00626
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7023377647582255231
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv2 + stage1_unit2_relu3 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CudnnConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CublasConvolution)
[05/21/2021-07:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit2_conv3 + _plus1 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.011136
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.011136
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.007424
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.007424
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.00756
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00756
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.008908
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.008908
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_bn1 + stage1_unit3_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CudnnConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CublasConvolution)
[05/21/2021-07:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv1 + stage1_unit3_relu2 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64) -> Float(200704,1,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16) -> Float(50176,1:4,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1) -> Half(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1) -> Half(100352,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Float(200704,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CudnnConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv2 + stage1_unit3_relu3 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8) -> Half(25088,1:8,448,8) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4) -> Half(12544,1:16,224,4) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,3136,56,1), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1,3584,64), Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,896,16), Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(200704,3136,56,1), Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,3136:2,56,1), Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CudnnConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CublasConvolution)
[05/21/2021-07:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage1_unit3_conv3 + _plus2 (CaskConvolution)
[05/21/2021-07:42:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,448,8), Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,224,4), Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.011164
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.011164
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(802816,1,14336,256) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(200704,1:4,3584,64) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(802816,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.007436
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.007436
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136:2,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.00768
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00768
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(100352,1:8,1792,32) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 0 Time: 0.008948
[05/21/2021-07:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.008948
[05/21/2021-07:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(50176,1:16,896,16) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_bn1 + stage2_unit1_relu1 (Scale)
[05/21/2021-07:42:26] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1) -> Float(401408,3136,56,1) ***************
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:42:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:26] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:26] [V] [TRT] Tactic: 589823 Time: 0.108416
[05/21/2021-07:42:26] [V] [TRT] Tactic: 655359 Time: 0.071656
[05/21/2021-07:42:26] [V] [TRT] Tactic: 786431 Time: 0.038808
[05/21/2021-07:42:26] [V] [TRT] Tactic: 851967 Time: 0.040344
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1179647 Time: 0.033584
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1310719 Time: 0.050208
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1376255 Time: 0.074016
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1441791 Time: 0.033652
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1507327 Time: 0.035068
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1638399 Time: 0.036016
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1835007 Time: 0.047508
[05/21/2021-07:42:26] [V] [TRT] Tactic: 1900543 Time: 0.051224
[05/21/2021-07:42:26] [V] [TRT] Tactic: 2097151 Time: 0.03484
[05/21/2021-07:42:26] [V] [TRT] Tactic: 2162687 Time: 0.05234
[05/21/2021-07:42:26] [V] [TRT] Tactic: 2293759 Time: 0.04984
[05/21/2021-07:42:26] [V] [TRT] Tactic: 2359295 Time: 0.048692
[05/21/2021-07:42:26] [V] [TRT] Tactic: 2686975 Time: 0.072704
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3080191 Time: 0.044452
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3342335 Time: 0.04736
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3407871 Time: 0.046244
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3538943 Time: 0.034608
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3670015 Time: 0.122648
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3932159 Time: 0.067328
[05/21/2021-07:42:26] [V] [TRT] Tactic: 3997695 Time: 0.037732
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4063231 Time: 0.033152
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4194303 Time: 0.036372
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4259839 Time: 0.034468
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4325375 Time: 0.03588
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4521983 Time: 0.070952
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4587519 Time: 0.038272
[05/21/2021-07:42:26] [V] [TRT] Tactic: 4653055 Time: 0.035088
[05/21/2021-07:42:27] [V] [TRT] Tactic: 4915199 Time: 0.033392
[05/21/2021-07:42:27] [V] [TRT] Tactic: 4980735 Time: 0.036488
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5177343 Time: 0.034672
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5242879 Time: 0.034816
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5373951 Time: 0.043008
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5439487 Time: 0.050084
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5570559 Time: 0.033984
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5636095 Time: 0.031236
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5701631 Time: 0.070788
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5767167 Time: 0.103052
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5832703 Time: 0.045056
[05/21/2021-07:42:27] [V] [TRT] Tactic: 5898239 Time: 0.03496
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6029311 Time: 0.068624
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6225919 Time: 0.033952
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6291455 Time: 0.033764
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6422527 Time: 0.044032
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6750207 Time: 0.041472
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6815743 Time: 0.046892
[05/21/2021-07:42:27] [V] [TRT] Tactic: 6946815 Time: 0.048292
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7012351 Time: 0.036416
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7077887 Time: 0.033664
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7143423 Time: 0.07108
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7208959 Time: 0.045952
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7340031 Time: 0.03572
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7405567 Time: 0.033304
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7536639 Time: 0.046456
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7602175 Time: 0.035828
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7733247 Time: 0.031772
[05/21/2021-07:42:27] [V] [TRT] Tactic: 7798783 Time: 0.03828
[05/21/2021-07:42:27] [V] [TRT] Tactic: 8191999 Time: 0.043276
[05/21/2021-07:42:27] [V] [TRT] Tactic: 8257535 Time: 0.0348
[05/21/2021-07:42:27] [V] [TRT] Tactic: 8323071 Time: 0.03894
[05/21/2021-07:42:27] [V] [TRT] Tactic: 8650751 Time: 0.038388
[05/21/2021-07:42:27] [V] [TRT] Tactic: 8716287 Time: 0.041656
[05/21/2021-07:42:27] [V] [TRT] Tactic: 9109503 Time: 0.037304
[05/21/2021-07:42:27] [V] [TRT] Tactic: 9568255 Time: 0.037028
[05/21/2021-07:42:27] [V] [TRT] Tactic: 9895935 Time: 0.036504
[05/21/2021-07:42:27] [V] [TRT] Tactic: 10223615 Time: 0.050176
[05/21/2021-07:42:27] [V] [TRT] Tactic: 10354687 Time: 0.037428
[05/21/2021-07:42:27] [V] [TRT] Tactic: 10551295 Time: 0.04778
[05/21/2021-07:42:28] [V] [TRT] Tactic: 10747903 Time: 0.035112
[05/21/2021-07:42:28] [V] [TRT] Tactic: 10944511 Time: 0.04574
[05/21/2021-07:42:28] [V] [TRT] Fastest Tactic: 5636095 Time: 0.031236
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:28] [V] [TRT] Tactic: 0 Time: 0.033792
[05/21/2021-07:42:28] [V] [TRT] Tactic: 1 Time: 0.034176
[05/21/2021-07:42:28] [V] [TRT] Tactic: 2 Time: 0.148352
[05/21/2021-07:42:28] [V] [TRT] Tactic: 4 Time: 3.0126
[05/21/2021-07:42:28] [V] [TRT] Tactic: 5 Time: 0.074444
[05/21/2021-07:42:28] [V] [TRT] Tactic: 56 Time: 0.034048
[05/21/2021-07:42:28] [V] [TRT] Tactic: 57 Time: 0.034116
[05/21/2021-07:42:28] [V] [TRT] Tactic: 58 Time: 0.147968
[05/21/2021-07:42:28] [V] [TRT] Tactic: 60 Time: 3.04916
[05/21/2021-07:42:28] [V] [TRT] Tactic: 61 Time: 0.074068
[05/21/2021-07:42:28] [V] [TRT] Tactic: 112 Time: 0.034176
[05/21/2021-07:42:28] [V] [TRT] Tactic: 113 Time: 0.034304
[05/21/2021-07:42:28] [V] [TRT] Tactic: 114 Time: 0.147764
[05/21/2021-07:42:28] [V] [TRT] Tactic: 116 Time: 3.03972
[05/21/2021-07:42:28] [V] [TRT] Tactic: 117 Time: 0.073628
[05/21/2021-07:42:28] [V] [TRT] Fastest Tactic: 0 Time: 0.033792
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:28] [V] [TRT] Tactic: 4549827808004681195 Time: 0.031616
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:28] [V] [TRT] Tactic: 5779835512569528575 Time: 0.035704
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:28] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0369
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:28] [V] [TRT] Tactic: -7491730084094677098 Time: 0.034244
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:28] [V] [TRT] Tactic: -6622064180404051845 Time: 0.039464
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:28] [V] [TRT] Tactic: -6313876406580483184 Time: 0.048024
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:28] [V] [TRT] Tactic: -6273689210331812572 Time: 0.036524
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:28] [V] [TRT] Tactic: -4337126844824617177 Time: 0.029672
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:28] [V] [TRT] Tactic: -1123676555321336786 Time: 0.036464
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:28] [V] [TRT] Tactic: -701551393537224327 Time: 0.032632
[05/21/2021-07:42:28] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.029672
[05/21/2021-07:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[05/21/2021-07:42:28] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256) -> Float(401408,1,7168,128) ***************
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:28] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:28] [V] [TRT] Tactic: 1663866669559596164 Time: 0.038656
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:28] [V] [TRT] Tactic: 2860655430572478466 Time: 0.024628
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:28] [V] [TRT] Tactic: 4474630279712975759 Time: 0.025088
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:28] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025108
[05/21/2021-07:42:28] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:29] [V] [TRT] Tactic: 4696204239951173149 Time: 0.022516
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:29] [V] [TRT] Tactic: 5778138195697110003 Time: 0.036088
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:29] [V] [TRT] Tactic: 8918020581761223752 Time: 0.036864
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:29] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022792
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:29] [V] [TRT] Tactic: -4035591156787122265 Time: 0.025344
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:29] [V] [TRT] Tactic: -2809379259463049391 Time: 0.038784
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:29] [V] [TRT] Tactic: -1985235291706575900 Time: 0.03648
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:29] [V] [TRT] Tactic: -504296718212024303 Time: 0.036596
[05/21/2021-07:42:29] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.022516
[05/21/2021-07:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149
[05/21/2021-07:42:29] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64) -> Float(100352,1:4,1792,32) ***************
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:29] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1373022415249282411 Time: 0.024584
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1663866669559596164 Time: 0.03584
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:29] [V] [TRT] Tactic: 2860655430572478466 Time: 0.02312
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:29] [V] [TRT] Tactic: 4474630279712975759 Time: 0.025396
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:29] [V] [TRT] Tactic: 4479823862704990365 Time: 0.025772
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:29] [V] [TRT] Tactic: 4696204239951173149 Time: 0.024728
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:29] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0393
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:29] [V] [TRT] Tactic: 8918020581761223752 Time: 0.036608
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:29] [V] [TRT] Tactic: -7067026478815706014 Time: 0.030164
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:29] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02304
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:29] [V] [TRT] Tactic: -4035591156787122265 Time: 0.025372
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:29] [V] [TRT] Tactic: -2809379259463049391 Time: 0.03892
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:29] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033492
[05/21/2021-07:42:29] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:29] [V] [TRT] Tactic: -504296718212024303 Time: 0.033804
[05/21/2021-07:42:29] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.02304
[05/21/2021-07:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701
[05/21/2021-07:42:29] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1) -> Half(401408,3136,56,1) ***************
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:29] [V] [TRT] Tactic: 0 Time: 0.031872
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1 Time: 0.031872
[05/21/2021-07:42:29] [V] [TRT] Tactic: 2 Time: 0.1536
[05/21/2021-07:42:29] [V] [TRT] Tactic: 4 Time: 2.97328
[05/21/2021-07:42:29] [V] [TRT] Tactic: 5 Time: 0.075344
[05/21/2021-07:42:29] [V] [TRT] Tactic: 56 Time: 0.03264
[05/21/2021-07:42:29] [V] [TRT] Tactic: 58 Time: 0.128
[05/21/2021-07:42:29] [V] [TRT] Tactic: 60 Time: 3.00616
[05/21/2021-07:42:29] [V] [TRT] Tactic: 61 Time: 0.074596
[05/21/2021-07:42:29] [V] [TRT] Fastest Tactic: 0 Time: 0.031872
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:42:29] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(401408,3136,56,1) ***************
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:29] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1) -> Half(200704,3136:2,56,1) ***************
[05/21/2021-07:42:29] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:29] [V] [TRT] Tactic: 589823 Time: 0.039168
[05/21/2021-07:42:29] [V] [TRT] Tactic: 655359 Time: 0.030208
[05/21/2021-07:42:29] [V] [TRT] Tactic: 786431 Time: 0.02134
[05/21/2021-07:42:29] [V] [TRT] Tactic: 851967 Time: 0.023328
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1179647 Time: 0.019036
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1310719 Time: 0.025368
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1376255 Time: 0.030464
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1441791 Time: 0.019336
[05/21/2021-07:42:29] [V] [TRT] Tactic: 1507327 Time: 0.021504
[05/21/2021-07:42:30] [V] [TRT] Tactic: 1638399 Time: 0.020352
[05/21/2021-07:42:30] [V] [TRT] Tactic: 1835007 Time: 0.02486
[05/21/2021-07:42:30] [V] [TRT] Tactic: 1900543 Time: 0.030748
[05/21/2021-07:42:30] [V] [TRT] Tactic: 2097151 Time: 0.020904
[05/21/2021-07:42:30] [V] [TRT] Tactic: 2162687 Time: 0.031324
[05/21/2021-07:42:30] [V] [TRT] Tactic: 2293759 Time: 0.029088
[05/21/2021-07:42:30] [V] [TRT] Tactic: 2359295 Time: 0.023068
[05/21/2021-07:42:30] [V] [TRT] Tactic: 2686975 Time: 0.030004
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3080191 Time: 0.021292
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3342335 Time: 0.022696
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3407871 Time: 0.022528
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3538943 Time: 0.019584
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3670015 Time: 0.050444
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3932159 Time: 0.027028
[05/21/2021-07:42:30] [V] [TRT] Tactic: 3997695 Time: 0.021772
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4063231 Time: 0.018864
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4194303 Time: 0.018852
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4259839 Time: 0.019248
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4325375 Time: 0.0191
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4521983 Time: 0.0294
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4587519 Time: 0.018608
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4653055 Time: 0.019584
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4915199 Time: 0.018752
[05/21/2021-07:42:30] [V] [TRT] Tactic: 4980735 Time: 0.0204
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5177343 Time: 0.020096
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5242879 Time: 0.020496
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5373951 Time: 0.023424
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5439487 Time: 0.026672
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5570559 Time: 0.022068
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5636095 Time: 0.019116
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5701631 Time: 0.028176
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5767167 Time: 0.052608
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5832703 Time: 0.021288
[05/21/2021-07:42:30] [V] [TRT] Tactic: 5898239 Time: 0.01962
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6029311 Time: 0.02804
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6225919 Time: 0.019228
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6291455 Time: 0.019328
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6422527 Time: 0.02112
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6750207 Time: 0.022784
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6815743 Time: 0.02496
[05/21/2021-07:42:30] [V] [TRT] Tactic: 6946815 Time: 0.02496
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7012351 Time: 0.021156
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7077887 Time: 0.01856
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7143423 Time: 0.03422
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7208959 Time: 0.021888
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7340031 Time: 0.019164
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7405567 Time: 0.01856
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7536639 Time: 0.02664
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7602175 Time: 0.0192
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7733247 Time: 0.018508
[05/21/2021-07:42:30] [V] [TRT] Tactic: 7798783 Time: 0.020736
[05/21/2021-07:42:30] [V] [TRT] Tactic: 8191999 Time: 0.023168
[05/21/2021-07:42:30] [V] [TRT] Tactic: 8257535 Time: 0.020396
[05/21/2021-07:42:30] [V] [TRT] Tactic: 8323071 Time: 0.021376
[05/21/2021-07:42:30] [V] [TRT] Tactic: 8650751 Time: 0.020992
[05/21/2021-07:42:30] [V] [TRT] Tactic: 8716287 Time: 0.02304
[05/21/2021-07:42:30] [V] [TRT] Tactic: 9109503 Time: 0.021652
[05/21/2021-07:42:30] [V] [TRT] Tactic: 9568255 Time: 0.018944
[05/21/2021-07:42:30] [V] [TRT] Tactic: 9895935 Time: 0.018996
[05/21/2021-07:42:30] [V] [TRT] Tactic: 10223615 Time: 0.029952
[05/21/2021-07:42:30] [V] [TRT] Tactic: 10354687 Time: 0.018688
[05/21/2021-07:42:30] [V] [TRT] Tactic: 10551295 Time: 0.023368
[05/21/2021-07:42:30] [V] [TRT] Tactic: 10747903 Time: 0.01856
[05/21/2021-07:42:30] [V] [TRT] Tactic: 10944511 Time: 0.020864
[05/21/2021-07:42:30] [V] [TRT] Fastest Tactic: 7733247 Time: 0.018508
[05/21/2021-07:42:30] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:30] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:30] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:30] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2195670545862694453 Time: 0.019708
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3891805945559659536 Time: 0.024576
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4418200634486186714 Time: 0.016384
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:31] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01742
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:31] [V] [TRT] Tactic: 6057304366605292508 Time: 0.01664
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:31] [V] [TRT] Tactic: 7392644644614664811 Time: 0.019784
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:31] [V] [TRT] Tactic: -4884039206922900293 Time: 0.024832
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:31] [V] [TRT] Tactic: -4374269919094467161 Time: 0.018756
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:31] [V] [TRT] Tactic: -1546027692247304867 Time: 0.02486
[05/21/2021-07:42:31] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.016384
[05/21/2021-07:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:42:31] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Float(401408,3136,56,1) ***************
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:31] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32) -> Half(50176,1:8,896,16) ***************
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:42:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:31] [V] [TRT] Tactic: 0 Time: 0.049792
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1 Time: 0.045184
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2 Time: 0.114048
[05/21/2021-07:42:31] [V] [TRT] Tactic: 56 Time: 0.049792
[05/21/2021-07:42:31] [V] [TRT] Tactic: 58 Time: 0.11392
[05/21/2021-07:42:31] [V] [TRT] Fastest Tactic: 1 Time: 0.045184
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:31] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:31] [V] [TRT] Tactic: 254850674756030979 Time: 0.016384
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1156328698016730421 Time: 0.011264
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012808
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1576319725282257846 Time: 0.010496
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1832046141070096030 Time: 0.010112
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009472
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:31] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0128
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009856
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2541579301352125276 Time: 0.011904
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2559328254295148085 Time: 0.016564
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01344
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:31] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009816
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012452
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009252
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3362537467505018070 Time: 0.011392
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3513075359009385578 Time: 0.017724
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3704534001553878387 Time: 0.01216
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:42:31] [V] [TRT] Tactic: 3899310434460415852 Time: 0.011264
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009608
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4370476717970497892 Time: 0.009728
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009344
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4491683531415781597 Time: 0.016896
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4528997467275241200 Time: 0.011952
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4571819373777460444 Time: 0.017176
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016556
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4802447371470387646 Time: 0.012676
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:42:31] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00816
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:31] [V] [TRT] Tactic: 5059676457552313631 Time: 0.016504
[05/21/2021-07:42:31] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:32] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011264
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:32] [V] [TRT] Tactic: 5346855796032465921 Time: 0.01334
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:32] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012544
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:32] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009352
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:32] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011648
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:32] [V] [TRT] Tactic: 6468794451065529747 Time: 0.010368
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:42:32] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00948
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:32] [V] [TRT] Tactic: 6859477213531075460 Time: 0.012068
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:32] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013312
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:32] [V] [TRT] Tactic: 7609923741161019135 Time: 0.009392
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:32] [V] [TRT] Tactic: 8101703987960976805 Time: 0.013176
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:32] [V] [TRT] Tactic: 8170606396342855895 Time: 0.010232
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:32] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012252
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:42:32] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008428
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:32] [V] [TRT] Tactic: 8839784824303350101 Time: 0.01386
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:42:32] [V] [TRT] Tactic: -9203179519031456182 Time: 0.009764
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:32] [V] [TRT] Tactic: -9009272790678027912 Time: 0.013452
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:32] [V] [TRT] Tactic: -8604374562669615024 Time: 0.012432
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:32] [V] [TRT] Tactic: -8280443484414412687 Time: 0.016648
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:32] [V] [TRT] Tactic: -8205952393017864204 Time: 0.017072
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:32] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009948
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:32] [V] [TRT] Tactic: -7410012245391920273 Time: 0.013068
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:32] [V] [TRT] Tactic: -7099920365135295801 Time: 0.009476
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:32] [V] [TRT] Tactic: -7089118800560870395 Time: 0.01204
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:42:32] [V] [TRT] Tactic: -6768327495007644783 Time: 0.010496
[05/21/2021-07:42:32] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:33] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01398
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:33] [V] [TRT] Tactic: -6063766379489217211 Time: 0.009984
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:33] [V] [TRT] Tactic: -5530886555766748586 Time: 0.011792
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:33] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00986
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:33] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009984
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:33] [V] [TRT] Tactic: -5127240325355316006 Time: 0.009088
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4950923835688973492 Time: 0.011648
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01024
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4548822885169694805 Time: 0.012268
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00882
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4293222705763522367 Time: 0.01124
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4152066959007262150 Time: 0.017792
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:33] [V] [TRT] Tactic: -4021926646879732549 Time: 0.01002
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3987638434926559037 Time: 0.010624
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3905653247016903130 Time: 0.012908
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012672
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3864869056275745423 Time: 0.013056
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3601464762214218301 Time: 0.012248
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:33] [V] [TRT] Tactic: -3058330359340425555 Time: 0.010004
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:33] [V] [TRT] Tactic: -2878731503146438856 Time: 0.010596
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:33] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011252
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:33] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012964
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:33] [V] [TRT] Tactic: -2032577876140256150 Time: 0.010368
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:33] [V] [TRT] Tactic: -2003055242756584050 Time: 0.009216
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1985778916402815946 Time: 0.013056
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1828674067637788567 Time: 0.013572
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009644
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1562548049711204899 Time: 0.01208
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009728
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1099247066487349374 Time: 0.012416
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:33] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009608
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:33] [V] [TRT] Tactic: -406984317033388136 Time: 0.011816
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:33] [V] [TRT] Tactic: -331499326992534460 Time: 0.008288
[05/21/2021-07:42:33] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:42:33] [V] [TRT] Tactic: -206523504474952360 Time: 0.011288
[05/21/2021-07:42:33] [V] [TRT] Fastest Tactic: 4993757826442493905 Time: 0.00816
[05/21/2021-07:42:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4993757826442493905
[05/21/2021-07:42:33] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16) -> Half(25088,1:16,448,8) ***************
[05/21/2021-07:42:33] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:42:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CublasConvolution)
[05/21/2021-07:42:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv1 + stage2_unit1_relu2 (CaskConvolution)
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:42:34] [V] [TRT] Tactic: 162720039126739803 Time: 0.008448
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:42:34] [V] [TRT] Tactic: 382577144988222004 Time: 0.009116
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 1466417369352598098
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1466417369352598098 Time: 0.008288
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:34] [V] [TRT] Tactic: 2334614616543277495 Time: 0.009216
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 3635375317854598708
[05/21/2021-07:42:34] [V] [TRT] Tactic: 3635375317854598708 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:34] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008372
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:42:34] [V] [TRT] Tactic: 6197123388212233554 Time: 0.012076
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:42:34] [V] [TRT] Tactic: 6466136707377588846 Time: 0.011256
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:42:34] [V] [TRT] Tactic: 6958123061428231366 Time: 0.008448
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:34] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008576
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:42:34] [V] [TRT] Tactic: -7023377647582255231 Time: 0.00832
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:42:34] [V] [TRT] Tactic: -6288137413706508928 Time: 0.012052
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:34] [V] [TRT] Tactic: -6148657501329441429 Time: 0.009392
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -3548326199661609828
[05/21/2021-07:42:34] [V] [TRT] Tactic: -3548326199661609828 Time: 0.009344
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:34] [V] [TRT] Tactic: -3396930063803107917 Time: 0.012032
[05/21/2021-07:42:34] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -2813185745402245055
[05/21/2021-07:42:34] [V] [TRT] Tactic: -2813185745402245055 Time: 0.008452
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1466417369352598098 Time: 0.008288
[05/21/2021-07:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1466417369352598098
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.011804
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009296
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.009296
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.010456
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.00842
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00842
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.00922
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007588
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.007588
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.009432
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.005156
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.005156
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.00628
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00628
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,3136,56,1) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.008824
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.008824
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.012596
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.00964
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00964
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.013336
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007572
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.007572
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.008748
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009276
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.008748
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009356
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.007612
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.00694
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00694
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,7168,128) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.007428
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.012544
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009472
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.009472
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.0128
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007552
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.007552
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009216
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.009088
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.009344
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007204
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,1792,32) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.009472
[05/21/2021-07:42:34] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.007168
[05/21/2021-07:42:34] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:34] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.009504
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.00888
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.009516
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.00888
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.011208
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.005548
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005548
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009372
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.005796
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005796
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,3136,56,1) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009344
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.009088
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.009088
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.010908
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007516
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007516
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.008824
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007808
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007808
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.014984
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.008712
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,3136:2,56,1) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.00812
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007168
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007688
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007832
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007692
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007692
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.012416
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009088
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,896,16) -> Half(25088,1:16,448,8) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007316
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007316
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.00854
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00854
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(401408,1,7168,128) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.006644
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.006644
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Float(100352,1:4,1792,32) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007984
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007936
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.007936
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(401408,3136,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.012488
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.00896
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00896
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(200704,3136:2,56,1) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.008996
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.009252
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.008996
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,448,8) -> Half(50176,1:8,896,16) (Reformat)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1002 Time: 0.007336
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.007424
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.007336
[05/21/2021-07:42:35] [V] [TRT] *************** Autotuning format combination: Float(401408,3136,56,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 458751 Time: 0.071552
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 458751 Time: 0.071552
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:35] [V] [TRT] Tactic: 0 Time: 0.061312
[05/21/2021-07:42:35] [V] [TRT] Tactic: 1 Time: 0.043776
[05/21/2021-07:42:35] [V] [TRT] Tactic: 2 Time: 0.13888
[05/21/2021-07:42:35] [V] [TRT] Tactic: 5 Time: 0.487768
[05/21/2021-07:42:35] [V] [TRT] Tactic: 56 Time: 0.060544
[05/21/2021-07:42:35] [V] [TRT] Tactic: 57 Time: 0.043392
[05/21/2021-07:42:35] [V] [TRT] Tactic: 58 Time: 0.138496
[05/21/2021-07:42:35] [V] [TRT] Tactic: 61 Time: 0.487704
[05/21/2021-07:42:35] [V] [TRT] Tactic: 112 Time: 0.057728
[05/21/2021-07:42:35] [V] [TRT] Tactic: 113 Time: 0.067072
[05/21/2021-07:42:35] [V] [TRT] Tactic: 114 Time: 0.131848
[05/21/2021-07:42:35] [V] [TRT] Tactic: 117 Time: 0.486268
[05/21/2021-07:42:35] [V] [TRT] Fastest Tactic: 57 Time: 0.043392
[05/21/2021-07:42:35] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:35] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:35] [V] [TRT] Tactic: 4549827808004681195 Time: 0.101376
[05/21/2021-07:42:35] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:36] [V] [TRT] Tactic: 5779835512569528575 Time: 0.131116
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:42:36] [V] [TRT] Tactic: 6053873026024413720 Time: 0.133248
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:42:36] [V] [TRT] Tactic: 6767548733843469815 Time: 0.104496
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:36] [V] [TRT] Tactic: -6313876406580483184 Time: 0.131652
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:36] [V] [TRT] Tactic: -1123676555321336786 Time: 0.131376
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:36] [V] [TRT] Tactic: -701551393537224327 Time: 0.11336
[05/21/2021-07:42:36] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.101376
[05/21/2021-07:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 57
[05/21/2021-07:42:36] [V] [TRT] *************** Autotuning format combination: Float(401408,1,7168,128) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:36] [V] [TRT] Tactic: 2860655430572478466 Time: 0.078208
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0448
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043508
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4696204239951173149 Time: 0.077696
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:36] [V] [TRT] Tactic: 5778138195697110003 Time: 0.138524
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:42:36] [V] [TRT] Tactic: 7155825427510256858 Time: 0.128808
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:36] [V] [TRT] Tactic: 8918020581761223752 Time: 0.127616
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:42:36] [V] [TRT] Tactic: -4756382386362004279 Time: 0.077568
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:42:36] [V] [TRT] Tactic: -3855385237722507464 Time: 0.140032
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:36] [V] [TRT] Tactic: -2809379259463049391 Time: 0.137048
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:36] [V] [TRT] Tactic: -504296718212024303 Time: 0.126088
[05/21/2021-07:42:36] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043508
[05/21/2021-07:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:42:36] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,1792,32) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:36] [V] [TRT] Tactic: 2860655430572478466 Time: 0.078184
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4474630279712975759 Time: 0.044928
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043776
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:36] [V] [TRT] Tactic: 4696204239951173149 Time: 0.07744
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:36] [V] [TRT] Tactic: 5778138195697110003 Time: 0.138384
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:42:36] [V] [TRT] Tactic: 7155825427510256858 Time: 0.130048
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:42:36] [V] [TRT] Tactic: 7342025736444949634 Time: 0.092184
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:36] [V] [TRT] Tactic: 8918020581761223752 Time: 0.125252
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:42:36] [V] [TRT] Tactic: -7377458734869418330 Time: 0.090244
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:42:36] [V] [TRT] Tactic: -5457304872213719461 Time: 0.091368
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:42:36] [V] [TRT] Tactic: -4756382386362004279 Time: 0.077052
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:42:36] [V] [TRT] Tactic: -3855385237722507464 Time: 0.139932
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:36] [V] [TRT] Tactic: -2809379259463049391 Time: 0.136868
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:36] [V] [TRT] Tactic: -504296718212024303 Time: 0.12608
[05/21/2021-07:42:36] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043776
[05/21/2021-07:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:42:36] [V] [TRT] *************** Autotuning format combination: Half(401408,3136,56,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:36] [V] [TRT] Tactic: 0 Time: 0.063872
[05/21/2021-07:42:36] [V] [TRT] Tactic: 1 Time: 0.06262
[05/21/2021-07:42:36] [V] [TRT] Tactic: 2 Time: 0.082432
[05/21/2021-07:42:36] [V] [TRT] Tactic: 5 Time: 0.49086
[05/21/2021-07:42:36] [V] [TRT] Tactic: 56 Time: 0.06258
[05/21/2021-07:42:36] [V] [TRT] Tactic: 58 Time: 0.079744
[05/21/2021-07:42:36] [V] [TRT] Tactic: 61 Time: 0.486144
[05/21/2021-07:42:36] [V] [TRT] Fastest Tactic: 56 Time: 0.06258
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:42:36] [V] [TRT] *************** Autotuning format combination: Half(200704,3136:2,56,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:42:36] [V] [TRT] Tactic: 458751 Time: 0.043648
[05/21/2021-07:42:36] [V] [TRT] Fastest Tactic: 458751 Time: 0.043648
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:36] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:36] [V] [TRT] Tactic: 2195670545862694453 Time: 0.062936
[05/21/2021-07:42:36] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:42:37] [V] [TRT] Tactic: 3419182076704469245 Time: 0.0614
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:37] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0864
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:37] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0595
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:37] [V] [TRT] Tactic: 6057304366605292508 Time: 0.054068
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:42:37] [V] [TRT] Tactic: -7928611605886347652 Time: 0.088332
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:42:37] [V] [TRT] Tactic: -5172391392092686714 Time: 0.065664
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:37] [V] [TRT] Tactic: -4374269919094467161 Time: 0.053748
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:37] [V] [TRT] Tactic: -1546027692247304867 Time: 0.087
[05/21/2021-07:42:37] [V] [TRT] Fastest Tactic: -4374269919094467161 Time: 0.053748
[05/21/2021-07:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751
[05/21/2021-07:42:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,896,16) -> Float(100352,784,28,1) ***************
[05/21/2021-07:42:37] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:37] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:37] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,896,16) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:42:37] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:37] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:37] [V] [TRT] Tactic: 0 Time: 0.089728
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1 Time: 0.0896
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2 Time: 0.132992
[05/21/2021-07:42:37] [V] [TRT] Tactic: 56 Time: 0.088064
[05/21/2021-07:42:37] [V] [TRT] Tactic: 58 Time: 0.132224
[05/21/2021-07:42:37] [V] [TRT] Fastest Tactic: 56 Time: 0.088064
[05/21/2021-07:42:37] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:37] [V] [TRT] Tactic: 254850674756030979 Time: 0.047616
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:42:37] [V] [TRT] Tactic: 328038211831149625 Time: 0.046624
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:42:37] [V] [TRT] Tactic: 411553864378931917 Time: 0.016512
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1011057357468998345 Time: 0.028884
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1156328698016730421 Time: 0.029196
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1723736032573714698 Time: 0.01536
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1832046141070096030 Time: 0.016408
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1838082074606840426 Time: 0.01728
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:37] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0116
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2428167804343994714 Time: 0.016896
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2541579301352125276 Time: 0.027264
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2657157263811141609 Time: 0.012648
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2819719497590964443 Time: 0.017452
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2968605903460894194 Time: 0.016664
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:42:37] [V] [TRT] Tactic: 2986078304285316765 Time: 0.028032
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:37] [V] [TRT] Tactic: 3362537467505018070 Time: 0.026752
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:37] [V] [TRT] Tactic: 3513075359009385578 Time: 0.047488
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:42:37] [V] [TRT] Tactic: 3573559043797674382 Time: 0.01664
[05/21/2021-07:42:37] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:42:38] [V] [TRT] Tactic: 3591970081995419777 Time: 0.01024
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:38] [V] [TRT] Tactic: 3704534001553878387 Time: 0.02752
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:38] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01686
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:42:38] [V] [TRT] Tactic: 4503233883285355107 Time: 0.013056
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:38] [V] [TRT] Tactic: 4802447371470387646 Time: 0.030852
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5059676457552313631 Time: 0.046804
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5368829646735632944 Time: 0.0114
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5398999388616959893 Time: 0.028024
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5746691132547383910 Time: 0.01666
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5770170567977052602 Time: 0.031884
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:42:38] [V] [TRT] Tactic: 5953552212833506549 Time: 0.025616
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6034364043891107501 Time: 0.015504
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6074229447555668232 Time: 0.012296
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6154447660803990543 Time: 0.017228
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6325769668000961702 Time: 0.027652
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6350273239113254096 Time: 0.010368
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6377497238381488891 Time: 0.026624
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6446388116965632819 Time: 0.016812
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6468794451065529747 Time: 0.017376
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6642277870194067185 Time: 0.048768
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011248
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6972489290272968208 Time: 0.026752
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:42:38] [V] [TRT] Tactic: 6979044990896381511 Time: 0.04608
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:38] [V] [TRT] Tactic: 7216571380637776659 Time: 0.03312
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:38] [V] [TRT] Tactic: 7609923741161019135 Time: 0.016396
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:42:38] [V] [TRT] Tactic: 7705739241028240201 Time: 0.012288
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:42:38] [V] [TRT] Tactic: 8072087735545283117 Time: 0.048
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:38] [V] [TRT] Tactic: 8101703987960976805 Time: 0.012444
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:38] [V] [TRT] Tactic: 8170606396342855895 Time: 0.017056
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:38] [V] [TRT] Tactic: 8839784824303350101 Time: 0.031616
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:42:38] [V] [TRT] Tactic: -9217371357561775773 Time: 0.012304
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:38] [V] [TRT] Tactic: -9009272790678027912 Time: 0.032968
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:42:38] [V] [TRT] Tactic: -8985224497679592364 Time: 0.013056
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:42:38] [V] [TRT] Tactic: -8949544755481315679 Time: 0.01728
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:42:38] [V] [TRT] Tactic: -8759929675070720385 Time: 0.026752
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:38] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011264
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:42:38] [V] [TRT] Tactic: -6902925267326201166 Time: 0.00936
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:42:38] [V] [TRT] Tactic: -6840588038605932325 Time: 0.017336
[05/21/2021-07:42:38] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6799856376604253964 Time: 0.047104
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6625722781282978136 Time: 0.017672
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6525498856028268801 Time: 0.02756
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012708
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6324345858751792783 Time: 0.017792
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6262400699544994312 Time: 0.046084
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6257787336162086472 Time: 0.029744
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:39] [V] [TRT] Tactic: -6063766379489217211 Time: 0.016812
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5777580938094193096 Time: 0.015668
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5657273398217409378 Time: 0.046396
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5530886555766748586 Time: 0.026624
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5422685219138380548 Time: 0.015376
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5161596964442251102 Time: 0.01692
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:39] [V] [TRT] Tactic: -5127240325355316006 Time: 0.016072
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4825567853927730435 Time: 0.016512
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4796511246675321840 Time: 0.017032
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4706569565442112734 Time: 0.012416
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4566599693570369588 Time: 0.0256
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4409144516525410768 Time: 0.026624
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4379519430184503304 Time: 0.016
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0484
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:39] [V] [TRT] Tactic: -4021926646879732549 Time: 0.016512
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3987638434926559037 Time: 0.017024
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3905653247016903130 Time: 0.028564
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3903974568488493144 Time: 0.01792
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3895429239811098010 Time: 0.016156
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3864869056275745423 Time: 0.030592
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011284
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3412636942650049698 Time: 0.028672
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3338665856053412950 Time: 0.025988
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:39] [V] [TRT] Tactic: -3058330359340425555 Time: 0.016384
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2816084650627734155 Time: 0.03332
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2662892962457732243 Time: 0.016384
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2559894581585337900 Time: 0.047232
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2530740716768816092 Time: 0.025856
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2332828394978346992 Time: 0.027196
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:42:39] [V] [TRT] Tactic: -2241736083352441442 Time: 0.034052
[05/21/2021-07:42:39] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:42:40] [V] [TRT] Tactic: -2161909437867201546 Time: 0.010896
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:40] [V] [TRT] Tactic: -1985778916402815946 Time: 0.031744
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:42:40] [V] [TRT] Tactic: -1500496213132463076 Time: 0.017408
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:40] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011272
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:42:40] [V] [TRT] Tactic: -910286698936744682 Time: 0.010336
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:42:40] [V] [TRT] Tactic: -606726295133751039 Time: 0.016768
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.00936
[05/21/2021-07:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166
[05/21/2021-07:42:40] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,448,8) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:42:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv2 + stage2_unit1_relu3 (CaskConvolution)
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1301213148470244380 Time: 0.014952
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:42:40] [V] [TRT] Tactic: 2140378925901736289 Time: 0.014508
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:42:40] [V] [TRT] Tactic: 7019285522757193163 Time: 0.0192
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:42:40] [V] [TRT] Tactic: 7616509406849244401 Time: 0.014848
[05/21/2021-07:42:40] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:42:40] [V] [TRT] Tactic: -6575010824547653277 Time: 0.011568
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.011568
[05/21/2021-07:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005112
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005112
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.009344
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.0054
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.0054
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.00658
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.00742
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004248
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004248
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,784,28,1) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005128
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005128
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.011048
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005536
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005536
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.007936
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005356
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005356
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005564
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005564
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006016
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004376
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004376
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,3584,128) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004784
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004784
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.011348
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.004776
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004776
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.0055
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.0055
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.007176
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.005612
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005612
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,896,32) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:42:40] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:42:40] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:40] [V] [TRT] Tactic: 1002 Time: 0.006188
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.00408
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00408
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.0051
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.0051
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.005116
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005116
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.00424
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00424
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.008108
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784,28,1) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.00782
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004172
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004172
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.010752
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007176
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004156
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004156
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,784:2,28,1) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004052
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004052
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004816
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004816
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006412
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.00424
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00424
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004084
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004084
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,448,16) -> Half(6272,1:16,224,8) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006844
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.005544
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005544
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(100352,1,3584,128) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006412
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.00478
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00478
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Float(25088,1:4,896,32) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006464
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004636
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004636
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(100352,784,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.005504
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005504
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(50176,784:2,28,1) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.00734
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,224,8) -> Half(12544,1:8,448,16) (Reformat)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:42:41] [V] [TRT] Tactic: 0 Time: 0.004396
[05/21/2021-07:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004396
[05/21/2021-07:42:41] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:41] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:42:41] [V] [TRT] Tactic: 589823 Time: 0.041728
[05/21/2021-07:42:41] [V] [TRT] Tactic: 655359 Time: 0.034048
[05/21/2021-07:42:41] [V] [TRT] Tactic: 786431 Time: 0.025856
[05/21/2021-07:42:41] [V] [TRT] Tactic: 851967 Time: 0.027196
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1179647 Time: 0.024448
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1310719 Time: 0.02752
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1376255 Time: 0.033792
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1441791 Time: 0.0255
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1507327 Time: 0.026256
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1638399 Time: 0.024916
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1835007 Time: 0.032
[05/21/2021-07:42:41] [V] [TRT] Tactic: 1900543 Time: 0.034364
[05/21/2021-07:42:41] [V] [TRT] Tactic: 2097151 Time: 0.0256
[05/21/2021-07:42:41] [V] [TRT] Tactic: 2162687 Time: 0.034304
[05/21/2021-07:42:41] [V] [TRT] Tactic: 2293759 Time: 0.034048
[05/21/2021-07:42:41] [V] [TRT] Tactic: 2359295 Time: 0.026672
[05/21/2021-07:42:41] [V] [TRT] Tactic: 2686975 Time: 0.032896
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3080191 Time: 0.026208
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3342335 Time: 0.026276
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3407871 Time: 0.02832
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3538943 Time: 0.02816
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3670015 Time: 0.049052
[05/21/2021-07:42:41] [V] [TRT] Tactic: 3932159 Time: 0.031744
[05/21/2021-07:42:42] [V] [TRT] Tactic: 3997695 Time: 0.026144
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4063231 Time: 0.023512
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4194303 Time: 0.022912
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4259839 Time: 0.023612
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4325375 Time: 0.023988
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4521983 Time: 0.031104
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4587519 Time: 0.025428
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4653055 Time: 0.024056
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4915199 Time: 0.024576
[05/21/2021-07:42:42] [V] [TRT] Tactic: 4980735 Time: 0.025004
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5177343 Time: 0.025764
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5242879 Time: 0.027008
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5373951 Time: 0.027816
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5439487 Time: 0.030976
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5570559 Time: 0.02478
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5636095 Time: 0.023552
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5701631 Time: 0.031912
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5767167 Time: 0.043392
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5832703 Time: 0.026752
[05/21/2021-07:42:42] [V] [TRT] Tactic: 5898239 Time: 0.023856
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6029311 Time: 0.031268
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6225919 Time: 0.024652
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6291455 Time: 0.024996
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6422527 Time: 0.02688
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6750207 Time: 0.028488
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6815743 Time: 0.027676
[05/21/2021-07:42:42] [V] [TRT] Tactic: 6946815 Time: 0.032896
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7012351 Time: 0.02496
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7077887 Time: 0.023552
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7143423 Time: 0.036864
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7208959 Time: 0.025856
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7340031 Time: 0.023552
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7405567 Time: 0.022528
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7536639 Time: 0.034816
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7602175 Time: 0.030336
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7733247 Time: 0.023936
[05/21/2021-07:42:42] [V] [TRT] Tactic: 7798783 Time: 0.025748
[05/21/2021-07:42:42] [V] [TRT] Tactic: 8191999 Time: 0.030836
[05/21/2021-07:42:42] [V] [TRT] Tactic: 8257535 Time: 0.025516
[05/21/2021-07:42:42] [V] [TRT] Tactic: 8323071 Time: 0.0272
[05/21/2021-07:42:42] [V] [TRT] Tactic: 8650751 Time: 0.026312
[05/21/2021-07:42:42] [V] [TRT] Tactic: 8716287 Time: 0.026112
[05/21/2021-07:42:42] [V] [TRT] Tactic: 9109503 Time: 0.025856
[05/21/2021-07:42:42] [V] [TRT] Tactic: 9568255 Time: 0.025088
[05/21/2021-07:42:42] [V] [TRT] Tactic: 9895935 Time: 0.02296
[05/21/2021-07:42:42] [V] [TRT] Tactic: 10223615 Time: 0.032812
[05/21/2021-07:42:42] [V] [TRT] Tactic: 10354687 Time: 0.02642
[05/21/2021-07:42:42] [V] [TRT] Tactic: 10551295 Time: 0.028804
[05/21/2021-07:42:42] [V] [TRT] Tactic: 10747903 Time: 0.023424
[05/21/2021-07:42:42] [V] [TRT] Tactic: 10944511 Time: 0.02496
[05/21/2021-07:42:42] [V] [TRT] Fastest Tactic: 7405567 Time: 0.022528
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:43] [V] [TRT] Tactic: 0 Time: 0.024624
[05/21/2021-07:42:43] [V] [TRT] Tactic: 1 Time: 0.021888
[05/21/2021-07:42:43] [V] [TRT] Tactic: 2 Time: 0.050552
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4 Time: 0.741248
[05/21/2021-07:42:43] [V] [TRT] Tactic: 5 Time: 0.067508
[05/21/2021-07:42:43] [V] [TRT] Tactic: 56 Time: 0.026368
[05/21/2021-07:42:43] [V] [TRT] Tactic: 57 Time: 0.02368
[05/21/2021-07:42:43] [V] [TRT] Tactic: 58 Time: 0.050872
[05/21/2021-07:42:43] [V] [TRT] Tactic: 60 Time: 0.741156
[05/21/2021-07:42:43] [V] [TRT] Tactic: 61 Time: 0.068296
[05/21/2021-07:42:43] [V] [TRT] Tactic: 112 Time: 0.025888
[05/21/2021-07:42:43] [V] [TRT] Tactic: 113 Time: 0.025856
[05/21/2021-07:42:43] [V] [TRT] Tactic: 114 Time: 0.051072
[05/21/2021-07:42:43] [V] [TRT] Tactic: 116 Time: 0.741108
[05/21/2021-07:42:43] [V] [TRT] Tactic: 117 Time: 0.068588
[05/21/2021-07:42:43] [V] [TRT] Fastest Tactic: 1 Time: 0.021888
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4549827808004681195 Time: 0.019328
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:43] [V] [TRT] Tactic: 5779835512569528575 Time: 0.022676
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:43] [V] [TRT] Tactic: 9151672657204310840 Time: 0.030464
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:43] [V] [TRT] Tactic: -7491730084094677098 Time: 0.021684
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:43] [V] [TRT] Tactic: -6622064180404051845 Time: 0.025612
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:43] [V] [TRT] Tactic: -6313876406580483184 Time: 0.022384
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:43] [V] [TRT] Tactic: -6273689210331812572 Time: 0.021624
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:43] [V] [TRT] Tactic: -4337126844824617177 Time: 0.017408
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:43] [V] [TRT] Tactic: -1123676555321336786 Time: 0.023296
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:43] [V] [TRT] Tactic: -701551393537224327 Time: 0.019812
[05/21/2021-07:42:43] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.017408
[05/21/2021-07:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[05/21/2021-07:42:43] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:43] [V] [TRT] Tactic: 1663866669559596164 Time: 0.021888
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:43] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015488
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017664
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017536
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4696204239951173149 Time: 0.015488
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:43] [V] [TRT] Tactic: 5778138195697110003 Time: 0.022144
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:43] [V] [TRT] Tactic: 8918020581761223752 Time: 0.020392
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:43] [V] [TRT] Tactic: -5905193483742532701 Time: 0.013868
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:43] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016384
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:43] [V] [TRT] Tactic: -2809379259463049391 Time: 0.021512
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:43] [V] [TRT] Tactic: -1985235291706575900 Time: 0.021284
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:43] [V] [TRT] Tactic: -504296718212024303 Time: 0.021248
[05/21/2021-07:42:43] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.013868
[05/21/2021-07:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701
[05/21/2021-07:42:43] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:43] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:43] [V] [TRT] Tactic: 1373022415249282411 Time: 0.018432
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:43] [V] [TRT] Tactic: 1663866669559596164 Time: 0.022016
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:43] [V] [TRT] Tactic: 2860655430572478466 Time: 0.015616
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017704
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017536
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:43] [V] [TRT] Tactic: 4696204239951173149 Time: 0.015336
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:43] [V] [TRT] Tactic: 5778138195697110003 Time: 0.02162
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:43] [V] [TRT] Tactic: 8918020581761223752 Time: 0.02048
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:43] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0154
[05/21/2021-07:42:43] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:44] [V] [TRT] Tactic: -5905193483742532701 Time: 0.013832
[05/21/2021-07:42:44] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:44] [V] [TRT] Tactic: -4035591156787122265 Time: 0.01756
[05/21/2021-07:42:44] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:44] [V] [TRT] Tactic: -2809379259463049391 Time: 0.022528
[05/21/2021-07:42:44] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:44] [V] [TRT] Tactic: -1985235291706575900 Time: 0.020992
[05/21/2021-07:42:44] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:44] [V] [TRT] Tactic: -504296718212024303 Time: 0.021008
[05/21/2021-07:42:44] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.013832
[05/21/2021-07:42:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701
[05/21/2021-07:42:44] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:42:44] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:44] [V] [TRT] Tactic: 0 Time: 0.015744
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1 Time: 0.015744
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2 Time: 0.04928
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4 Time: 0.739444
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5 Time: 0.068008
[05/21/2021-07:42:44] [V] [TRT] Tactic: 56 Time: 0.015744
[05/21/2021-07:42:44] [V] [TRT] Tactic: 58 Time: 0.048796
[05/21/2021-07:42:44] [V] [TRT] Tactic: 60 Time: 0.7411
[05/21/2021-07:42:44] [V] [TRT] Tactic: 61 Time: 0.067668
[05/21/2021-07:42:44] [V] [TRT] Fastest Tactic: 0 Time: 0.015744
[05/21/2021-07:42:44] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:44] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:42:44] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:42:44] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:44] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:42:44] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:42:44] [V] [TRT] Tactic: 589823 Time: 0.024192
[05/21/2021-07:42:44] [V] [TRT] Tactic: 655359 Time: 0.020748
[05/21/2021-07:42:44] [V] [TRT] Tactic: 786431 Time: 0.015496
[05/21/2021-07:42:44] [V] [TRT] Tactic: 851967 Time: 0.016652
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1179647 Time: 0.014592
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1310719 Time: 0.0177
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1376255 Time: 0.02048
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1441791 Time: 0.014336
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1507327 Time: 0.015664
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1638399 Time: 0.0149
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1835007 Time: 0.017804
[05/21/2021-07:42:44] [V] [TRT] Tactic: 1900543 Time: 0.02074
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2097151 Time: 0.015488
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2162687 Time: 0.02048
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2293759 Time: 0.020004
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2359295 Time: 0.015648
[05/21/2021-07:42:44] [V] [TRT] Tactic: 2686975 Time: 0.019192
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3080191 Time: 0.01538
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3342335 Time: 0.015624
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3407871 Time: 0.016248
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3538943 Time: 0.015528
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3670015 Time: 0.028644
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3932159 Time: 0.01842
[05/21/2021-07:42:44] [V] [TRT] Tactic: 3997695 Time: 0.01534
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4063231 Time: 0.014368
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4194303 Time: 0.01434
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4259839 Time: 0.01536
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4325375 Time: 0.014104
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4521983 Time: 0.019504
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4587519 Time: 0.015124
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4653055 Time: 0.01536
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4915199 Time: 0.014304
[05/21/2021-07:42:44] [V] [TRT] Tactic: 4980735 Time: 0.015232
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5177343 Time: 0.014428
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5242879 Time: 0.015488
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5373951 Time: 0.016144
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5439487 Time: 0.017408
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5570559 Time: 0.015276
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5636095 Time: 0.014272
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5701631 Time: 0.018788
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5767167 Time: 0.023556
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5832703 Time: 0.015604
[05/21/2021-07:42:44] [V] [TRT] Tactic: 5898239 Time: 0.014332
[05/21/2021-07:42:44] [V] [TRT] Tactic: 6029311 Time: 0.018432
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6225919 Time: 0.01432
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6291455 Time: 0.01446
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6422527 Time: 0.015604
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6750207 Time: 0.016388
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6815743 Time: 0.017084
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6946815 Time: 0.01924
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7012351 Time: 0.015536
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7077887 Time: 0.014552
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7143423 Time: 0.020608
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7208959 Time: 0.015512
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7340031 Time: 0.014368
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7405567 Time: 0.01408
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7536639 Time: 0.018604
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7602175 Time: 0.017292
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7733247 Time: 0.013696
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7798783 Time: 0.015512
[05/21/2021-07:42:45] [V] [TRT] Tactic: 8191999 Time: 0.017536
[05/21/2021-07:42:45] [V] [TRT] Tactic: 8257535 Time: 0.014624
[05/21/2021-07:42:45] [V] [TRT] Tactic: 8323071 Time: 0.015516
[05/21/2021-07:42:45] [V] [TRT] Tactic: 8650751 Time: 0.01526
[05/21/2021-07:42:45] [V] [TRT] Tactic: 8716287 Time: 0.0154
[05/21/2021-07:42:45] [V] [TRT] Tactic: 9109503 Time: 0.015524
[05/21/2021-07:42:45] [V] [TRT] Tactic: 9568255 Time: 0.014548
[05/21/2021-07:42:45] [V] [TRT] Tactic: 9895935 Time: 0.01418
[05/21/2021-07:42:45] [V] [TRT] Tactic: 10223615 Time: 0.01932
[05/21/2021-07:42:45] [V] [TRT] Tactic: 10354687 Time: 0.01446
[05/21/2021-07:42:45] [V] [TRT] Tactic: 10551295 Time: 0.017144
[05/21/2021-07:42:45] [V] [TRT] Tactic: 10747903 Time: 0.013412
[05/21/2021-07:42:45] [V] [TRT] Tactic: 10944511 Time: 0.014848
[05/21/2021-07:42:45] [V] [TRT] Fastest Tactic: 10747903 Time: 0.013412
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:45] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:45] [V] [TRT] Tactic: 2195670545862694453 Time: 0.01426
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:45] [V] [TRT] Tactic: 3891805945559659536 Time: 0.016396
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:45] [V] [TRT] Tactic: 4418200634486186714 Time: 0.012288
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:45] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01314
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:45] [V] [TRT] Tactic: 6057304366605292508 Time: 0.012672
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:45] [V] [TRT] Tactic: 7392644644614664811 Time: 0.01288
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:45] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0159
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:45] [V] [TRT] Tactic: -4374269919094467161 Time: 0.01232
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:45] [V] [TRT] Tactic: -1546027692247304867 Time: 0.015516
[05/21/2021-07:42:45] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.012288
[05/21/2021-07:42:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:42:45] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(401408,784,28,1) ***************
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:45] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:45] [V] [TRT] Tactic: 0 Time: 0.026112
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1 Time: 0.025088
[05/21/2021-07:42:45] [V] [TRT] Tactic: 2 Time: 0.056752
[05/21/2021-07:42:45] [V] [TRT] Tactic: 56 Time: 0.024704
[05/21/2021-07:42:45] [V] [TRT] Tactic: 58 Time: 0.056728
[05/21/2021-07:42:45] [V] [TRT] Fastest Tactic: 56 Time: 0.024704
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:45] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:45] [V] [TRT] Tactic: 254850674756030979 Time: 0.012928
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1156328698016730421 Time: 0.009748
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1362727228442059924 Time: 0.009856
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1576319725282257846 Time: 0.008448
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1832046141070096030 Time: 0.007588
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:45] [V] [TRT] Tactic: 1838082074606840426 Time: 0.008176
[05/21/2021-07:42:45] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:46] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009984
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:46] [V] [TRT] Tactic: 2238656696610018305 Time: 0.008608
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:46] [V] [TRT] Tactic: 2541579301352125276 Time: 0.009516
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:46] [V] [TRT] Tactic: 2559328254295148085 Time: 0.012672
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:46] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0104
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:46] [V] [TRT] Tactic: 2968605903460894194 Time: 0.008744
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010364
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3359475309458902373 Time: 0.008324
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3362537467505018070 Time: 0.009812
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3513075359009385578 Time: 0.012332
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3704534001553878387 Time: 0.009216
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:42:46] [V] [TRT] Tactic: 3899310434460415852 Time: 0.008364
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4278315135102886928 Time: 0.007412
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4370476717970497892 Time: 0.007692
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4480294673430783793 Time: 0.007944
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4491683531415781597 Time: 0.012544
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00958
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4571819373777460444 Time: 0.012416
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4595173549602041350 Time: 0.012712
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01024
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:42:46] [V] [TRT] Tactic: 4993757826442493905 Time: 0.007732
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:46] [V] [TRT] Tactic: 5059676457552313631 Time: 0.012416
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:46] [V] [TRT] Tactic: 5205510332404400949 Time: 0.009288
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:46] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011064
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:46] [V] [TRT] Tactic: 5398999388616959893 Time: 0.009556
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:46] [V] [TRT] Tactic: 6034364043891107501 Time: 0.007148
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:46] [V] [TRT] Tactic: 6377497238381488891 Time: 0.009196
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:46] [V] [TRT] Tactic: 6468794451065529747 Time: 0.008436
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:42:46] [V] [TRT] Tactic: 6697277555581639516 Time: 0.007808
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:46] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009496
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:46] [V] [TRT] Tactic: 7216571380637776659 Time: 0.010368
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:46] [V] [TRT] Tactic: 7609923741161019135 Time: 0.007972
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:46] [V] [TRT] Tactic: 8101703987960976805 Time: 0.010648
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:46] [V] [TRT] Tactic: 8170606396342855895 Time: 0.00896
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:46] [V] [TRT] Tactic: 8764780417487154889 Time: 0.009984
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:42:46] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008448
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:46] [V] [TRT] Tactic: 8839784824303350101 Time: 0.009216
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:42:46] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007192
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:46] [V] [TRT] Tactic: -9009272790678027912 Time: 0.010232
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:46] [V] [TRT] Tactic: -8604374562669615024 Time: 0.010012
[05/21/2021-07:42:46] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:47] [V] [TRT] Tactic: -8280443484414412687 Time: 0.012676
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:47] [V] [TRT] Tactic: -8205952393017864204 Time: 0.012752
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:47] [V] [TRT] Tactic: -8131857373260504832 Time: 0.00896
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:47] [V] [TRT] Tactic: -7410012245391920273 Time: 0.010496
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:47] [V] [TRT] Tactic: -7099920365135295801 Time: 0.007712
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:47] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009088
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:42:47] [V] [TRT] Tactic: -6768327495007644783 Time: 0.008244
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:47] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01036
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:47] [V] [TRT] Tactic: -6063766379489217211 Time: 0.007516
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:47] [V] [TRT] Tactic: -5530886555766748586 Time: 0.008576
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:47] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008352
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:47] [V] [TRT] Tactic: -5161596964442251102 Time: 0.008472
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:47] [V] [TRT] Tactic: -5127240325355316006 Time: 0.007816
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009132
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4796511246675321840 Time: 0.008632
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4548822885169694805 Time: 0.01014
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008064
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0086
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4152066959007262150 Time: 0.012244
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:47] [V] [TRT] Tactic: -4021926646879732549 Time: 0.007388
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:47] [V] [TRT] Tactic: -3987638434926559037 Time: 0.008756
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:47] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01028
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:47] [V] [TRT] Tactic: -3903342530518878192 Time: 0.009856
[05/21/2021-07:42:47] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:47] [V] [TRT] Tactic: -3864869056275745423 Time: 0.011576
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:48] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010264
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:48] [V] [TRT] Tactic: -3058330359340425555 Time: 0.00838
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:48] [V] [TRT] Tactic: -2878731503146438856 Time: 0.010496
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:48] [V] [TRT] Tactic: -2602982885923184927 Time: 0.00956
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:48] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01024
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:48] [V] [TRT] Tactic: -2032577876140256150 Time: 0.00852
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:48] [V] [TRT] Tactic: -2003055242756584050 Time: 0.007268
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0095
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00978
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1640527254204634147 Time: 0.008192
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1562548049711204899 Time: 0.010032
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1242202084391243207 Time: 0.007884
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009628
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:48] [V] [TRT] Tactic: -1038291877007553549 Time: 0.00808
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:48] [V] [TRT] Tactic: -406984317033388136 Time: 0.009344
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:48] [V] [TRT] Tactic: -331499326992534460 Time: 0.007424
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:42:48] [V] [TRT] Tactic: -206523504474952360 Time: 0.010292
[05/21/2021-07:42:48] [V] [TRT] Fastest Tactic: 6034364043891107501 Time: 0.007148
[05/21/2021-07:42:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6034364043891107501
[05/21/2021-07:42:48] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:42:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:42:48] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CublasConvolution)
[05/21/2021-07:42:48] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:48] [V] [TRT] --------------- Timing Runner: stage2_unit1_conv3 (CaskConvolution)
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:42:48] [V] [TRT] Tactic: 162720039126739803 Time: 0.006272
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:42:48] [V] [TRT] Tactic: 382577144988222004 Time: 0.006324
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:48] [V] [TRT] Tactic: 2334614616543277495 Time: 0.00824
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:48] [V] [TRT] Tactic: 4126996489741716394 Time: 0.007216
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:42:48] [V] [TRT] Tactic: 6197123388212233554 Time: 0.008192
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:42:48] [V] [TRT] Tactic: 6466136707377588846 Time: 0.00832
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:42:48] [V] [TRT] Tactic: 6958123061428231366 Time: 0.006952
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:48] [V] [TRT] Tactic: 8940522081427638481 Time: 0.006784
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:42:48] [V] [TRT] Tactic: -7023377647582255231 Time: 0.006656
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:42:48] [V] [TRT] Tactic: -6288137413706508928 Time: 0.007868
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:48] [V] [TRT] Tactic: -6148657501329441429 Time: 0.006512
[05/21/2021-07:42:48] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:48] [V] [TRT] Tactic: -3396930063803107917 Time: 0.007456
[05/21/2021-07:42:48] [V] [TRT] Fastest Tactic: 162720039126739803 Time: 0.006272
[05/21/2021-07:42:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 162720039126739803
[05/21/2021-07:42:48] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:48] [V] [TRT] Tactic: 1002 Time: 0.010956
[05/21/2021-07:42:48] [V] [TRT] Tactic: 0 Time: 0.009512
[05/21/2021-07:42:48] [V] [TRT] Fastest Tactic: 0 Time: 0.009512
[05/21/2021-07:42:48] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.01198
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.010632
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.010632
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.011108
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007788
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007788
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.009984
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.005604
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005604
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008448
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00586
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00586
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.010112
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.013056
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009856
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.01304
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007428
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007428
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.009368
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.00844
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.009228
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.00844
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.007544
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.0064
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0064
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.007196
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007552
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.007196
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.013096
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00986
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00986
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.013184
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008968
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008968
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.009136
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00964
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.009136
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.007208
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00784
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.007208
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007676
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.007552
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.011428
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008832
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.01012
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008832
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008616
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.01036
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.008616
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.011188
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00542
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00542
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.009976
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.009924
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009924
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.0114
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.00548
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00548
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.009108
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007996
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007996
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008748
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.008192
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.008192
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.0145
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.005264
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005264
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.008672
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.005036
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005036
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.00838
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.007208
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.007208
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.010348
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.005252
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.005252
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:49] [V] [TRT] Tactic: 1002 Time: 0.007152
[05/21/2021-07:42:49] [V] [TRT] Tactic: 0 Time: 0.006512
[05/21/2021-07:42:49] [V] [TRT] Fastest Tactic: 0 Time: 0.006512
[05/21/2021-07:42:49] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.007892
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.008192
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.007892
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.012288
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.004652
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004652
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.007484
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.010552
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.0096
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0096
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.006256
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006256
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.011284
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.00976
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00976
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.00916
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.009768
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.00916
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:50] [V] [TRT] *************** Autotuning format combination: Float(802816,3136,56,1), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (FusedConvActConvolution)
[05/21/2021-07:42:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:50] [V] [TRT] Tactic: 0 Time: 0.03432
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1 Time: 0.03846
[05/21/2021-07:42:50] [V] [TRT] Tactic: 2 Time: 0.1376
[05/21/2021-07:42:50] [V] [TRT] Tactic: 56 Time: 0.034452
[05/21/2021-07:42:50] [V] [TRT] Tactic: 57 Time: 0.0384
[05/21/2021-07:42:50] [V] [TRT] Tactic: 58 Time: 0.137356
[05/21/2021-07:42:50] [V] [TRT] Tactic: 112 Time: 0.034584
[05/21/2021-07:42:50] [V] [TRT] Tactic: 113 Time: 0.038576
[05/21/2021-07:42:50] [V] [TRT] Tactic: 114 Time: 0.137216
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: 0 Time: 0.03432
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:50] [V] [TRT] Tactic: 4549827808004681195 Time: 0.034688
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:50] [V] [TRT] Tactic: 5779835512569528575 Time: 0.04018
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:50] [V] [TRT] Tactic: 9151672657204310840 Time: 0.042032
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:50] [V] [TRT] Tactic: -7491730084094677098 Time: 0.044444
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:50] [V] [TRT] Tactic: -6313876406580483184 Time: 0.051456
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:50] [V] [TRT] Tactic: -6273689210331812572 Time: 0.043792
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:50] [V] [TRT] Tactic: -4337126844824617177 Time: 0.032808
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:50] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0431
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:50] [V] [TRT] Tactic: -701551393537224327 Time: 0.035968
[05/21/2021-07:42:50] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.032808
[05/21/2021-07:42:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[05/21/2021-07:42:50] [V] [TRT] *************** Autotuning format combination: Float(802816,1,14336,256), Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:50] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.041088
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:50] [V] [TRT] Tactic: 2860655430572478466 Time: 0.02752
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:50] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02922
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:50] [V] [TRT] Tactic: 4479823862704990365 Time: 0.02584
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:50] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02354
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:50] [V] [TRT] Tactic: 5778138195697110003 Time: 0.03736
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:50] [V] [TRT] Tactic: 8918020581761223752 Time: 0.038432
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:50] [V] [TRT] Tactic: -5905193483742532701 Time: 0.025856
[05/21/2021-07:42:50] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:51] [V] [TRT] Tactic: -4035591156787122265 Time: 0.028832
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:51] [V] [TRT] Tactic: -2809379259463049391 Time: 0.04126
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:51] [V] [TRT] Tactic: -1985235291706575900 Time: 0.037776
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:51] [V] [TRT] Tactic: -504296718212024303 Time: 0.0384
[05/21/2021-07:42:51] [V] [TRT] Fastest Tactic: 4696204239951173149 Time: 0.02354
[05/21/2021-07:42:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4696204239951173149
[05/21/2021-07:42:51] [V] [TRT] *************** Autotuning format combination: Float(200704,1:4,3584,64), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:51] [V] [TRT] Tactic: 1373022415249282411 Time: 0.029568
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:51] [V] [TRT] Tactic: 1663866669559596164 Time: 0.037168
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:51] [V] [TRT] Tactic: 2860655430572478466 Time: 0.023688
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:51] [V] [TRT] Tactic: 4474630279712975759 Time: 0.026036
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:51] [V] [TRT] Tactic: 4479823862704990365 Time: 0.026928
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:51] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02756
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:51] [V] [TRT] Tactic: 5778138195697110003 Time: 0.041984
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:42:51] [V] [TRT] Tactic: 7342025736444949634 Time: 0.029568
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:51] [V] [TRT] Tactic: 8918020581761223752 Time: 0.03804
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:51] [V] [TRT] Tactic: -5905193483742532701 Time: 0.025564
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:42:51] [V] [TRT] Tactic: -5457304872213719461 Time: 0.02986
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:51] [V] [TRT] Tactic: -4035591156787122265 Time: 0.028584
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:51] [V] [TRT] Tactic: -2809379259463049391 Time: 0.041344
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:51] [V] [TRT] Tactic: -1985235291706575900 Time: 0.038016
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:51] [V] [TRT] Tactic: -504296718212024303 Time: 0.038288
[05/21/2021-07:42:51] [V] [TRT] Fastest Tactic: 2860655430572478466 Time: 0.023688
[05/21/2021-07:42:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2860655430572478466
[05/21/2021-07:42:51] [V] [TRT] *************** Autotuning format combination: Half(802816,3136,56,1), Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:51] [V] [TRT] Tactic: 0 Time: 0.030108
[05/21/2021-07:42:51] [V] [TRT] Tactic: 1 Time: 0.029952
[05/21/2021-07:42:51] [V] [TRT] Tactic: 2 Time: 0.093396
[05/21/2021-07:42:51] [V] [TRT] Tactic: 56 Time: 0.030312
[05/21/2021-07:42:51] [V] [TRT] Tactic: 58 Time: 0.097428
[05/21/2021-07:42:51] [V] [TRT] Fastest Tactic: 1 Time: 0.029952
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:42:51] [V] [TRT] *************** Autotuning format combination: Half(401408,3136:2,56,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (FusedConvActConvolution)
[05/21/2021-07:42:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:42:51] [V] [TRT] Tactic: 2195670545862694453 Time: 0.021392
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:42:51] [V] [TRT] Tactic: 3891805945559659536 Time: 0.025772
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:42:51] [V] [TRT] Tactic: 4418200634486186714 Time: 0.018068
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:42:51] [V] [TRT] Tactic: 5548126322150286555 Time: 0.01922
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:42:51] [V] [TRT] Tactic: 6057304366605292508 Time: 0.018688
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:42:51] [V] [TRT] Tactic: 7392644644614664811 Time: 0.01908
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:42:51] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0246
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:42:51] [V] [TRT] Tactic: -4374269919094467161 Time: 0.018944
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:42:51] [V] [TRT] Tactic: -1546027692247304867 Time: 0.024696
[05/21/2021-07:42:51] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.018068
[05/21/2021-07:42:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:42:51] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] *************** Autotuning format combination: Half(100352,1:8,1792,32), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudaDepthwiseConvolution)
[05/21/2021-07:42:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:51] [V] [TRT] Tactic: 0 Time: 0.048028
[05/21/2021-07:42:51] [V] [TRT] Tactic: 1 Time: 0.044188
[05/21/2021-07:42:51] [V] [TRT] Tactic: 2 Time: 0.111384
[05/21/2021-07:42:51] [V] [TRT] Tactic: 56 Time: 0.046892
[05/21/2021-07:42:51] [V] [TRT] Tactic: 58 Time: 0.111792
[05/21/2021-07:42:51] [V] [TRT] Fastest Tactic: 1 Time: 0.044188
[05/21/2021-07:42:51] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:42:51] [V] [TRT] Tactic: 254850674756030979 Time: 0.018176
[05/21/2021-07:42:51] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1011057357468998345 Time: 0.012928
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01228
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1362727228442059924 Time: 0.013148
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1576319725282257846 Time: 0.010232
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1832046141070096030 Time: 0.010112
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1838082074606840426 Time: 0.010624
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:42:52] [V] [TRT] Tactic: 1899296423087490472 Time: 0.013652
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2238656696610018305 Time: 0.010112
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2428167804343994714 Time: 0.009772
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2541579301352125276 Time: 0.012416
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2559328254295148085 Time: 0.01728
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2657157263811141609 Time: 0.013788
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:42:52] [V] [TRT] Tactic: 2968605903460894194 Time: 0.010624
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:42:52] [V] [TRT] Tactic: 3071479995783211391 Time: 0.014468
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:42:52] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010388
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:42:52] [V] [TRT] Tactic: 3362537467505018070 Time: 0.012288
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:42:52] [V] [TRT] Tactic: 3513075359009385578 Time: 0.017816
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:42:52] [V] [TRT] Tactic: 3704534001553878387 Time: 0.012276
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:42:52] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009204
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:42:52] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0096
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:42:52] [V] [TRT] Tactic: 4571819373777460444 Time: 0.018132
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:42:52] [V] [TRT] Tactic: 4802447371470387646 Time: 0.013568
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:42:52] [V] [TRT] Tactic: 5059676457552313631 Time: 0.017976
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:42:52] [V] [TRT] Tactic: 5205510332404400949 Time: 0.012312
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:42:52] [V] [TRT] Tactic: 5346855796032465921 Time: 0.013312
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:42:52] [V] [TRT] Tactic: 5368829646735632944 Time: 0.010228
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:42:52] [V] [TRT] Tactic: 5398999388616959893 Time: 0.01344
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:42:52] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00924
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:42:52] [V] [TRT] Tactic: 6154447660803990543 Time: 0.010196
[05/21/2021-07:42:52] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6325769668000961702 Time: 0.011704
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6350273239113254096 Time: 0.015548
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6377497238381488891 Time: 0.012712
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6468794451065529747 Time: 0.01104
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6859477213531075460 Time: 0.012468
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:42:53] [V] [TRT] Tactic: 6979044990896381511 Time: 0.01728
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:42:53] [V] [TRT] Tactic: 7216571380637776659 Time: 0.014336
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:42:53] [V] [TRT] Tactic: 7609923741161019135 Time: 0.009728
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:42:53] [V] [TRT] Tactic: 8072087735545283117 Time: 0.017024
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:42:53] [V] [TRT] Tactic: 8101703987960976805 Time: 0.013312
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:42:53] [V] [TRT] Tactic: 8170606396342855895 Time: 0.010336
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:42:53] [V] [TRT] Tactic: 8764780417487154889 Time: 0.012376
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:42:53] [V] [TRT] Tactic: 8839784824303350101 Time: 0.013752
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:42:53] [V] [TRT] Tactic: -9009272790678027912 Time: 0.014236
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8985224497679592364 Time: 0.010116
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8759929675070720385 Time: 0.012672
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8604374562669615024 Time: 0.012712
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8280443484414412687 Time: 0.017664
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8205952393017864204 Time: 0.01728
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:42:53] [V] [TRT] Tactic: -8131857373260504832 Time: 0.010368
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:42:53] [V] [TRT] Tactic: -7410012245391920273 Time: 0.013056
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:42:53] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008868
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:42:53] [V] [TRT] Tactic: -7089118800560870395 Time: 0.011416
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:42:53] [V] [TRT] Tactic: -6799856376604253964 Time: 0.016384
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:42:53] [V] [TRT] Tactic: -6525498856028268801 Time: 0.011264
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:42:53] [V] [TRT] Tactic: -6356316196810535311 Time: 0.014336
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:42:53] [V] [TRT] Tactic: -6324345858751792783 Time: 0.010924
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:42:53] [V] [TRT] Tactic: -6063766379489217211 Time: 0.010276
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5777580938094193096 Time: 0.008884
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5657273398217409378 Time: 0.017288
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5530886555766748586 Time: 0.012568
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5409588854490562130 Time: 0.009984
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009676
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:42:53] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008448
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:42:53] [V] [TRT] Tactic: -4950923835688973492 Time: 0.01032
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:42:53] [V] [TRT] Tactic: -4825567853927730435 Time: 0.008212
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:42:53] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01102
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:42:53] [V] [TRT] Tactic: -4548822885169694805 Time: 0.013596
[05/21/2021-07:42:53] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:42:54] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010012
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:42:54] [V] [TRT] Tactic: -4293222705763522367 Time: 0.01172
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:42:54] [V] [TRT] Tactic: -4152066959007262150 Time: 0.01792
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:42:54] [V] [TRT] Tactic: -4021926646879732549 Time: 0.01002
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3987638434926559037 Time: 0.010624
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3905653247016903130 Time: 0.013184
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3903974568488493144 Time: 0.00888
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012752
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3864869056275745423 Time: 0.013312
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011428
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3338665856053412950 Time: 0.013056
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:42:54] [V] [TRT] Tactic: -3058330359340425555 Time: 0.010112
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2878731503146438856 Time: 0.012564
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2662892962457732243 Time: 0.009344
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2602982885923184927 Time: 0.012584
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2530740716768816092 Time: 0.011816
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2353603993968373338 Time: 0.013568
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2332828394978346992 Time: 0.011808
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2161909437867201546 Time: 0.0133
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2032577876140256150 Time: 0.01024
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:42:54] [V] [TRT] Tactic: -2003055242756584050 Time: 0.008684
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1985778916402815946 Time: 0.014592
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1640527254204634147 Time: 0.010292
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1562548049711204899 Time: 0.012288
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0096
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1099247066487349374 Time: 0.012544
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:42:54] [V] [TRT] Tactic: -1038291877007553549 Time: 0.010112
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:42:54] [V] [TRT] Tactic: -910286698936744682 Time: 0.0121
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:42:54] [V] [TRT] Tactic: -606726295133751039 Time: 0.00974
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:42:54] [V] [TRT] Tactic: -406984317033388136 Time: 0.012468
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:42:54] [V] [TRT] Tactic: -331499326992534460 Time: 0.009756
[05/21/2021-07:42:54] [V] [TRT] Fastest Tactic: -4825567853927730435 Time: 0.008212
[05/21/2021-07:42:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4825567853927730435
[05/21/2021-07:42:54] [V] [TRT] *************** Autotuning format combination: Half(50176,1:16,896,16), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:42:54] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CudnnConvolution)
[05/21/2021-07:42:54] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:54] [V] [TRT] --------------- Timing Runner: stage2_unit1_sc + _plus3 (CaskConvolution)
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:42:54] [V] [TRT] Tactic: 1301213148470244380 Time: 0.009348
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:42:54] [V] [TRT] Tactic: 2140378925901736289 Time: 0.008832
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:42:54] [V] [TRT] Tactic: 2334614616543277495 Time: 0.010536
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:42:54] [V] [TRT] Tactic: 4126996489741716394 Time: 0.009096
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:42:54] [V] [TRT] Tactic: 6197123388212233554 Time: 0.01114
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:42:54] [V] [TRT] Tactic: 7019285522757193163 Time: 0.010624
[05/21/2021-07:42:54] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:42:55] [V] [TRT] Tactic: 7616509406849244401 Time: 0.009088
[05/21/2021-07:42:55] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:42:55] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008748
[05/21/2021-07:42:55] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_no_preds Tactic: -7172990105084720569
[05/21/2021-07:42:55] [V] [TRT] Tactic: -7172990105084720569 Time: 0.010364
[05/21/2021-07:42:55] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:42:55] [V] [TRT] Tactic: -6575010824547653277 Time: 0.010276
[05/21/2021-07:42:55] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:42:55] [V] [TRT] Tactic: -6148657501329441429 Time: 0.010496
[05/21/2021-07:42:55] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:42:55] [V] [TRT] Tactic: -3396930063803107917 Time: 0.011008
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 8940522081427638481 Time: 0.008748
[05/21/2021-07:42:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8940522081427638481
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.011792
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.010368
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.010368
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.011572
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.01056
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.01056
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.011016
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007336
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007336
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.009972
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.005768
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005768
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.005608
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005608
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009372
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.008064
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.011904
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.009856
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.013312
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.00754
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.00754
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.009224
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.0096
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.009224
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.00912
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009856
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00912
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007008
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007008
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(401408,1,14336,512) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007196
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007196
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.013056
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009948
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.009948
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.013108
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.00826
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009216
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00826
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.00832
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.009344
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.00832
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.008192
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1:4,3584,128) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.007696
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007956
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.007696
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.011296
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.008796
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.010156
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.008796
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.008448
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.010236
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.008448
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.0113
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.005524
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005524
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:55] [V] [TRT] Tactic: 1002 Time: 0.009604
[05/21/2021-07:42:55] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:42:55] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:42:55] [V] [TRT] --------------- Timing Runner: reformat: Half(401408,784,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.009476
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.012444
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.005424
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005424
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.009264
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.00812
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00812
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.008152
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.008152
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.01472
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.005408
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005408
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.008336
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.0049
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0049
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784:2,28,1) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.008452
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007424
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007424
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.010624
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.007596
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007184
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007184
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007148
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007148
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.008212
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,1:8,1792,64) -> Half(25088,1:16,896,32) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.007856
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007552
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007552
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.01088
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.00978
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.00978
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(401408,1,14336,512) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007296
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007296
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Float(100352,1:4,3584,128) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.00782
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007808
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007808
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(401408,784,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.012164
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.009216
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.009216
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(200704,784:2,28,1) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.009616
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:16,896,32) -> Half(50176,1:8,1792,64) (Reformat)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.007192
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007192
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.006156
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.006156
[05/21/2021-07:42:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.005124
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005124
[05/21/2021-07:42:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.005172
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.005172
[05/21/2021-07:42:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 0 Time: 0.006172
[05/21/2021-07:42:56] [V] [TRT] Fastest Tactic: 0 Time: 0.006172
[05/21/2021-07:42:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_bn1 + stage2_unit2_relu1 (Scale)
[05/21/2021-07:42:56] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:42:56] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:42:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:56] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:56] [V] [TRT] Tactic: 589823 Time: 0.114176
[05/21/2021-07:42:56] [V] [TRT] Tactic: 655359 Time: 0.073392
[05/21/2021-07:42:56] [V] [TRT] Tactic: 786431 Time: 0.030208
[05/21/2021-07:42:56] [V] [TRT] Tactic: 851967 Time: 0.0264
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1179647 Time: 0.020888
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1310719 Time: 0.050596
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1376255 Time: 0.076676
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1441791 Time: 0.019492
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1507327 Time: 0.042916
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1638399 Time: 0.022016
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1835007 Time: 0.034564
[05/21/2021-07:42:56] [V] [TRT] Tactic: 1900543 Time: 0.077264
[05/21/2021-07:42:56] [V] [TRT] Tactic: 2097151 Time: 0.018728
[05/21/2021-07:42:56] [V] [TRT] Tactic: 2162687 Time: 0.07874
[05/21/2021-07:42:56] [V] [TRT] Tactic: 2293759 Time: 0.07232
[05/21/2021-07:42:57] [V] [TRT] Tactic: 2359295 Time: 0.044832
[05/21/2021-07:42:57] [V] [TRT] Tactic: 2686975 Time: 0.072064
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3080191 Time: 0.03694
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3342335 Time: 0.044108
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3407871 Time: 0.041496
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3538943 Time: 0.027176
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3670015 Time: 0.140288
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3932159 Time: 0.064384
[05/21/2021-07:42:57] [V] [TRT] Tactic: 3997695 Time: 0.022172
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4063231 Time: 0.026276
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4194303 Time: 0.030976
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4259839 Time: 0.019456
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4325375 Time: 0.0256
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4521983 Time: 0.072736
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4587519 Time: 0.023228
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4653055 Time: 0.019768
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4915199 Time: 0.021888
[05/21/2021-07:42:57] [V] [TRT] Tactic: 4980735 Time: 0.040236
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5177343 Time: 0.021044
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5242879 Time: 0.0379
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5373951 Time: 0.023168
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5439487 Time: 0.032916
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5570559 Time: 0.040832
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5636095 Time: 0.0256
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5701631 Time: 0.068616
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5767167 Time: 0.053148
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5832703 Time: 0.039936
[05/21/2021-07:42:57] [V] [TRT] Tactic: 5898239 Time: 0.0191
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6029311 Time: 0.06916
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6225919 Time: 0.026764
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6291455 Time: 0.020752
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6422527 Time: 0.038412
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6750207 Time: 0.02496
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6815743 Time: 0.041236
[05/21/2021-07:42:57] [V] [TRT] Tactic: 6946815 Time: 0.032068
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7012351 Time: 0.018596
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7077887 Time: 0.027776
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7143423 Time: 0.042332
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7208959 Time: 0.041316
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7340031 Time: 0.020104
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7405567 Time: 0.02368
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7536639 Time: 0.063608
[05/21/2021-07:42:57] [V] [TRT] Tactic: 7602175 Time: 0.029352
[05/21/2021-07:42:58] [V] [TRT] Tactic: 7733247 Time: 0.026624
[05/21/2021-07:42:58] [V] [TRT] Tactic: 7798783 Time: 0.029004
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8191999 Time: 0.030308
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8257535 Time: 0.021396
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8323071 Time: 0.03102
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8650751 Time: 0.030088
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8716287 Time: 0.027932
[05/21/2021-07:42:58] [V] [TRT] Tactic: 9109503 Time: 0.018128
[05/21/2021-07:42:58] [V] [TRT] Tactic: 9568255 Time: 0.021908
[05/21/2021-07:42:58] [V] [TRT] Tactic: 9895935 Time: 0.031488
[05/21/2021-07:42:58] [V] [TRT] Tactic: 10223615 Time: 0.073376
[05/21/2021-07:42:58] [V] [TRT] Tactic: 10354687 Time: 0.023168
[05/21/2021-07:42:58] [V] [TRT] Tactic: 10551295 Time: 0.044544
[05/21/2021-07:42:58] [V] [TRT] Tactic: 10747903 Time: 0.02658
[05/21/2021-07:42:58] [V] [TRT] Tactic: 10944511 Time: 0.040492
[05/21/2021-07:42:58] [V] [TRT] Fastest Tactic: 9109503 Time: 0.018128
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:58] [V] [TRT] Tactic: 0 Time: 0.03072
[05/21/2021-07:42:58] [V] [TRT] Tactic: 1 Time: 0.030724
[05/21/2021-07:42:58] [V] [TRT] Tactic: 2 Time: 0.091856
[05/21/2021-07:42:58] [V] [TRT] Tactic: 4 Time: 0.746012
[05/21/2021-07:42:58] [V] [TRT] Tactic: 5 Time: 0.094776
[05/21/2021-07:42:58] [V] [TRT] Tactic: 56 Time: 0.031272
[05/21/2021-07:42:58] [V] [TRT] Tactic: 57 Time: 0.03072
[05/21/2021-07:42:58] [V] [TRT] Tactic: 58 Time: 0.091596
[05/21/2021-07:42:58] [V] [TRT] Tactic: 60 Time: 0.744832
[05/21/2021-07:42:58] [V] [TRT] Tactic: 61 Time: 0.097012
[05/21/2021-07:42:58] [V] [TRT] Tactic: 112 Time: 0.032512
[05/21/2021-07:42:58] [V] [TRT] Tactic: 113 Time: 0.031744
[05/21/2021-07:42:58] [V] [TRT] Tactic: 114 Time: 0.114588
[05/21/2021-07:42:58] [V] [TRT] Tactic: 116 Time: 0.744216
[05/21/2021-07:42:58] [V] [TRT] Tactic: 117 Time: 0.097376
[05/21/2021-07:42:58] [V] [TRT] Fastest Tactic: 57 Time: 0.03072
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:42:58] [V] [TRT] Tactic: 4549827808004681195 Time: 0.05002
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:42:58] [V] [TRT] Tactic: 5779835512569528575 Time: 0.062848
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:42:58] [V] [TRT] Tactic: 9151672657204310840 Time: 0.059552
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:42:58] [V] [TRT] Tactic: -7491730084094677098 Time: 0.061108
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:42:58] [V] [TRT] Tactic: -6622064180404051845 Time: 0.056448
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:42:58] [V] [TRT] Tactic: -6313876406580483184 Time: 0.064
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:42:58] [V] [TRT] Tactic: -6273689210331812572 Time: 0.061548
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:42:58] [V] [TRT] Tactic: -4337126844824617177 Time: 0.04608
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:42:58] [V] [TRT] Tactic: -1123676555321336786 Time: 0.062608
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:42:58] [V] [TRT] Tactic: -701551393537224327 Time: 0.053504
[05/21/2021-07:42:58] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.04608
[05/21/2021-07:42:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503
[05/21/2021-07:42:58] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:58] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:58] [V] [TRT] Tactic: 1663866669559596164 Time: 0.065024
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:58] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038932
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:58] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024208
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:58] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023816
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:58] [V] [TRT] Tactic: 4696204239951173149 Time: 0.038304
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:58] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06592
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:58] [V] [TRT] Tactic: 8918020581761223752 Time: 0.05982
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:58] [V] [TRT] Tactic: -5905193483742532701 Time: 0.033904
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:58] [V] [TRT] Tactic: -4035591156787122265 Time: 0.02258
[05/21/2021-07:42:58] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:58] [V] [TRT] Tactic: -2809379259463049391 Time: 0.064256
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:59] [V] [TRT] Tactic: -1985235291706575900 Time: 0.05942
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:59] [V] [TRT] Tactic: -504296718212024303 Time: 0.062564
[05/21/2021-07:42:59] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.02258
[05/21/2021-07:42:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:42:59] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1373022415249282411 Time: 0.04664
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06494
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2860655430572478466 Time: 0.03896
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:42:59] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024192
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:42:59] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023808
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:42:59] [V] [TRT] Tactic: 4696204239951173149 Time: 0.037888
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:42:59] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06578
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:42:59] [V] [TRT] Tactic: 8918020581761223752 Time: 0.058744
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:42:59] [V] [TRT] Tactic: -7067026478815706014 Time: 0.04736
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:42:59] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034816
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:42:59] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023332
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:42:59] [V] [TRT] Tactic: -2809379259463049391 Time: 0.065024
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:42:59] [V] [TRT] Tactic: -1985235291706575900 Time: 0.059792
[05/21/2021-07:42:59] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:42:59] [V] [TRT] Tactic: -504296718212024303 Time: 0.06046
[05/21/2021-07:42:59] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023332
[05/21/2021-07:42:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:42:59] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:42:59] [V] [TRT] Tactic: 0 Time: 0.033664
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1 Time: 0.03392
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2 Time: 0.11968
[05/21/2021-07:42:59] [V] [TRT] Tactic: 4 Time: 0.741348
[05/21/2021-07:42:59] [V] [TRT] Tactic: 5 Time: 0.095272
[05/21/2021-07:42:59] [V] [TRT] Tactic: 56 Time: 0.033004
[05/21/2021-07:42:59] [V] [TRT] Tactic: 58 Time: 0.117376
[05/21/2021-07:42:59] [V] [TRT] Tactic: 60 Time: 0.741116
[05/21/2021-07:42:59] [V] [TRT] Tactic: 61 Time: 0.098064
[05/21/2021-07:42:59] [V] [TRT] Fastest Tactic: 56 Time: 0.033004
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:42:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:42:59] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:42:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:42:59] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:42:59] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:42:59] [V] [TRT] Tactic: 589823 Time: 0.061228
[05/21/2021-07:42:59] [V] [TRT] Tactic: 655359 Time: 0.043648
[05/21/2021-07:42:59] [V] [TRT] Tactic: 786431 Time: 0.019232
[05/21/2021-07:42:59] [V] [TRT] Tactic: 851967 Time: 0.01728
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1179647 Time: 0.01344
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1310719 Time: 0.032132
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1376255 Time: 0.045172
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1441791 Time: 0.013356
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1507327 Time: 0.02662
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1638399 Time: 0.014616
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1835007 Time: 0.018816
[05/21/2021-07:42:59] [V] [TRT] Tactic: 1900543 Time: 0.046364
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2097151 Time: 0.012476
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2162687 Time: 0.046592
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2293759 Time: 0.041728
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2359295 Time: 0.026672
[05/21/2021-07:42:59] [V] [TRT] Tactic: 2686975 Time: 0.0419
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3080191 Time: 0.023552
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3342335 Time: 0.026624
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3407871 Time: 0.023552
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3538943 Time: 0.015392
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3670015 Time: 0.080896
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3932159 Time: 0.03638
[05/21/2021-07:42:59] [V] [TRT] Tactic: 3997695 Time: 0.014336
[05/21/2021-07:42:59] [V] [TRT] Tactic: 4063231 Time: 0.01666
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4194303 Time: 0.01856
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4259839 Time: 0.013056
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4325375 Time: 0.014848
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4521983 Time: 0.041856
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4587519 Time: 0.013484
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4653055 Time: 0.013312
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4915199 Time: 0.013696
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4980735 Time: 0.022724
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5177343 Time: 0.013596
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5242879 Time: 0.022564
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5373951 Time: 0.014464
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5439487 Time: 0.020224
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5570559 Time: 0.025672
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5636095 Time: 0.017176
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5701631 Time: 0.039716
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5767167 Time: 0.02986
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5832703 Time: 0.02432
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5898239 Time: 0.014
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6029311 Time: 0.038316
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6225919 Time: 0.015104
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6291455 Time: 0.013312
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6422527 Time: 0.022528
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6750207 Time: 0.015396
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6815743 Time: 0.024576
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6946815 Time: 0.01976
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7012351 Time: 0.012544
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7077887 Time: 0.015488
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7143423 Time: 0.024856
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7208959 Time: 0.024704
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7340031 Time: 0.013568
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7405567 Time: 0.014592
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7536639 Time: 0.036096
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7602175 Time: 0.018372
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7733247 Time: 0.016768
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7798783 Time: 0.01896
[05/21/2021-07:43:00] [V] [TRT] Tactic: 8191999 Time: 0.017876
[05/21/2021-07:43:00] [V] [TRT] Tactic: 8257535 Time: 0.013312
[05/21/2021-07:43:00] [V] [TRT] Tactic: 8323071 Time: 0.018584
[05/21/2021-07:43:00] [V] [TRT] Tactic: 8650751 Time: 0.01856
[05/21/2021-07:43:00] [V] [TRT] Tactic: 8716287 Time: 0.016804
[05/21/2021-07:43:00] [V] [TRT] Tactic: 9109503 Time: 0.012308
[05/21/2021-07:43:00] [V] [TRT] Tactic: 9568255 Time: 0.01372
[05/21/2021-07:43:00] [V] [TRT] Tactic: 9895935 Time: 0.018072
[05/21/2021-07:43:00] [V] [TRT] Tactic: 10223615 Time: 0.041984
[05/21/2021-07:43:00] [V] [TRT] Tactic: 10354687 Time: 0.013312
[05/21/2021-07:43:00] [V] [TRT] Tactic: 10551295 Time: 0.02622
[05/21/2021-07:43:00] [V] [TRT] Tactic: 10747903 Time: 0.016384
[05/21/2021-07:43:00] [V] [TRT] Tactic: 10944511 Time: 0.022528
[05/21/2021-07:43:00] [V] [TRT] Fastest Tactic: 9109503 Time: 0.012308
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:00] [V] [TRT] Tactic: 2195670545862694453 Time: 0.030336
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:00] [V] [TRT] Tactic: 3891805945559659536 Time: 0.04224
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:00] [V] [TRT] Tactic: 4418200634486186714 Time: 0.026552
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:00] [V] [TRT] Tactic: 5548126322150286555 Time: 0.028928
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:00] [V] [TRT] Tactic: 6057304366605292508 Time: 0.027924
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:00] [V] [TRT] Tactic: 7392644644614664811 Time: 0.027168
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:00] [V] [TRT] Tactic: -4884039206922900293 Time: 0.041144
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:00] [V] [TRT] Tactic: -4374269919094467161 Time: 0.027676
[05/21/2021-07:43:00] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:00] [V] [TRT] Tactic: -1546027692247304867 Time: 0.042208
[05/21/2021-07:43:00] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.026552
[05/21/2021-07:43:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503
[05/21/2021-07:43:00] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:43:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:00] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:00] [V] [TRT] Tactic: 0 Time: 0.0453
[05/21/2021-07:43:00] [V] [TRT] Tactic: 1 Time: 0.045312
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2 Time: 0.111488
[05/21/2021-07:43:01] [V] [TRT] Tactic: 56 Time: 0.04608
[05/21/2021-07:43:01] [V] [TRT] Tactic: 58 Time: 0.108672
[05/21/2021-07:43:01] [V] [TRT] Fastest Tactic: 0 Time: 0.0453
[05/21/2021-07:43:01] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:01] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.025612
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1156328698016730421 Time: 0.017152
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017664
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011688
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011268
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011264
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:01] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008448
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2238656696610018305 Time: 0.010624
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01536
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025112
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009504
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:01] [V] [TRT] Tactic: 2968605903460894194 Time: 0.01152
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3071479995783211391 Time: 0.00746
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011648
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3362537467505018070 Time: 0.015804
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3513075359009385578 Time: 0.026112
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016384
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:43:01] [V] [TRT] Tactic: 3899310434460415852 Time: 0.008192
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4278315135102886928 Time: 0.010492
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4370476717970497892 Time: 0.010432
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009988
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4491683531415781597 Time: 0.023936
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4528997467275241200 Time: 0.016008
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025884
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4595173549602041350 Time: 0.024868
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4802447371470387646 Time: 0.017664
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:43:01] [V] [TRT] Tactic: 4993757826442493905 Time: 0.010388
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:01] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0256
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:01] [V] [TRT] Tactic: 5205510332404400949 Time: 0.015636
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:01] [V] [TRT] Tactic: 5346855796032465921 Time: 0.01664
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:01] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016676
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:01] [V] [TRT] Tactic: 6034364043891107501 Time: 0.010244
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:01] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01536
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011324
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:43:01] [V] [TRT] Tactic: 6697277555581639516 Time: 0.009456
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008832
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.019072
[05/21/2021-07:43:01] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:02] [V] [TRT] Tactic: 7609923741161019135 Time: 0.010572
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:02] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009132
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:02] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01152
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:02] [V] [TRT] Tactic: 8764780417487154889 Time: 0.016384
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:43:02] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010624
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:02] [V] [TRT] Tactic: 8839784824303350101 Time: 0.017728
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:43:02] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00838
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:02] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018816
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:02] [V] [TRT] Tactic: -8604374562669615024 Time: 0.008576
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:02] [V] [TRT] Tactic: -8280443484414412687 Time: 0.024736
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:02] [V] [TRT] Tactic: -8205952393017864204 Time: 0.024064
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:02] [V] [TRT] Tactic: -8131857373260504832 Time: 0.010276
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:02] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00922
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:02] [V] [TRT] Tactic: -7099920365135295801 Time: 0.010624
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:02] [V] [TRT] Tactic: -7089118800560870395 Time: 0.008496
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:43:02] [V] [TRT] Tactic: -6768327495007644783 Time: 0.015552
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:02] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009344
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:02] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011264
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:02] [V] [TRT] Tactic: -5530886555766748586 Time: 0.015744
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:02] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008192
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:02] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011264
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:02] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010368
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00724
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011272
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00832
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011136
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00832
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0259
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:02] [V] [TRT] Tactic: -4021926646879732549 Time: 0.010908
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:02] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011392
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:02] [V] [TRT] Tactic: -3905653247016903130 Time: 0.017408
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:02] [V] [TRT] Tactic: -3903342530518878192 Time: 0.017272
[05/21/2021-07:43:02] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:03] [V] [TRT] Tactic: -3864869056275745423 Time: 0.017392
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:03] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00832
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:03] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011124
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:03] [V] [TRT] Tactic: -2878731503146438856 Time: 0.01668
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:03] [V] [TRT] Tactic: -2602982885923184927 Time: 0.015488
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:03] [V] [TRT] Tactic: -2353603993968373338 Time: 0.017604
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:03] [V] [TRT] Tactic: -2032577876140256150 Time: 0.01176
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:03] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010244
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1985778916402815946 Time: 0.018224
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0072
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1640527254204634147 Time: 0.010472
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1562548049711204899 Time: 0.014808
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1242202084391243207 Time: 0.010256
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009472
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:03] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011136
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:03] [V] [TRT] Tactic: -406984317033388136 Time: 0.015916
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:03] [V] [TRT] Tactic: -331499326992534460 Time: 0.010496
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:43:03] [V] [TRT] Tactic: -206523504474952360 Time: 0.01626
[05/21/2021-07:43:03] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.0072
[05/21/2021-07:43:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567
[05/21/2021-07:43:03] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:03] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:03] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:03] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:03] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv1 + stage2_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:43:03] [V] [TRT] Tactic: 162720039126739803 Time: 0.008324
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:43:03] [V] [TRT] Tactic: 382577144988222004 Time: 0.010436
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2334614616543277495 Time: 0.010916
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:03] [V] [TRT] Tactic: 4126996489741716394 Time: 0.0074
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:43:03] [V] [TRT] Tactic: 6197123388212233554 Time: 0.007764
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:43:03] [V] [TRT] Tactic: 6466136707377588846 Time: 0.007792
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:43:03] [V] [TRT] Tactic: 6958123061428231366 Time: 0.007296
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:03] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008832
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:43:03] [V] [TRT] Tactic: -7023377647582255231 Time: 0.007424
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:43:03] [V] [TRT] Tactic: -6288137413706508928 Time: 0.008112
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:03] [V] [TRT] Tactic: -6148657501329441429 Time: 0.008192
[05/21/2021-07:43:03] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:03] [V] [TRT] Tactic: -3396930063803107917 Time: 0.008192
[05/21/2021-07:43:03] [V] [TRT] Fastest Tactic: 6958123061428231366 Time: 0.007296
[05/21/2021-07:43:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6958123061428231366
[05/21/2021-07:43:03] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:03] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:03] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:03] [V] [TRT] Tactic: 524287 Time: 0.054336
[05/21/2021-07:43:03] [V] [TRT] Tactic: 720895 Time: 0.04668
[05/21/2021-07:43:03] [V] [TRT] Tactic: 983039 Time: 0.027392
[05/21/2021-07:43:03] [V] [TRT] Tactic: 1048575 Time: 0.040576
[05/21/2021-07:43:03] [V] [TRT] Tactic: 1703935 Time: 0.029992
[05/21/2021-07:43:03] [V] [TRT] Tactic: 1769471 Time: 0.02654
[05/21/2021-07:43:03] [V] [TRT] Tactic: 1966079 Time: 0.093312
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2031615 Time: 0.074112
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2228223 Time: 0.04096
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2424831 Time: 0.02156
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2621439 Time: 0.027648
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2752511 Time: 0.049292
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2818047 Time: 0.047796
[05/21/2021-07:43:03] [V] [TRT] Tactic: 2883583 Time: 0.10344
[05/21/2021-07:43:04] [V] [TRT] Tactic: 3014655 Time: 0.02782
[05/21/2021-07:43:04] [V] [TRT] Tactic: 3145727 Time: 0.029696
[05/21/2021-07:43:04] [V] [TRT] Tactic: 3473407 Time: 0.05952
[05/21/2021-07:43:04] [V] [TRT] Tactic: 3604479 Time: 0.02752
[05/21/2021-07:43:04] [V] [TRT] Tactic: 3735551 Time: 0.047872
[05/21/2021-07:43:04] [V] [TRT] Tactic: 4390911 Time: 0.095508
[05/21/2021-07:43:04] [V] [TRT] Tactic: 5046271 Time: 0.034816
[05/21/2021-07:43:04] [V] [TRT] Tactic: 5963775 Time: 0.080564
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6160383 Time: 0.049328
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6488063 Time: 0.04318
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6881279 Time: 0.06696
[05/21/2021-07:43:04] [V] [TRT] Tactic: 7274495 Time: 0.022276
[05/21/2021-07:43:04] [V] [TRT] Tactic: 7864319 Time: 0.02142
[05/21/2021-07:43:04] [V] [TRT] Tactic: 7995391 Time: 0.05064
[05/21/2021-07:43:04] [V] [TRT] Tactic: 8585215 Time: 0.06144
[05/21/2021-07:43:04] [V] [TRT] Tactic: 8847359 Time: 0.021936
[05/21/2021-07:43:04] [V] [TRT] Tactic: 8978431 Time: 0.081452
[05/21/2021-07:43:04] [V] [TRT] Tactic: 9043967 Time: 0.025676
[05/21/2021-07:43:04] [V] [TRT] Tactic: 9175039 Time: 0.027648
[05/21/2021-07:43:04] [V] [TRT] Tactic: 9502719 Time: 0.092476
[05/21/2021-07:43:04] [V] [TRT] Tactic: 9830399 Time: 0.048032
[05/21/2021-07:43:04] [V] [TRT] Tactic: 9961471 Time: 0.023996
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10027007 Time: 0.036992
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10092543 Time: 0.09536
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10289151 Time: 0.093184
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10485759 Time: 0.027776
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10682367 Time: 0.027412
[05/21/2021-07:43:04] [V] [TRT] Tactic: 10813439 Time: 0.03088
[05/21/2021-07:43:04] [V] [TRT] Fastest Tactic: 7864319 Time: 0.02142
[05/21/2021-07:43:04] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:04] [V] [TRT] Tactic: 0 Time: 0.0561
[05/21/2021-07:43:04] [V] [TRT] Tactic: 1 Time: 0.05312
[05/21/2021-07:43:04] [V] [TRT] Tactic: 2 Time: 0.104484
[05/21/2021-07:43:04] [V] [TRT] Tactic: 4 Time: 0.214644
[05/21/2021-07:43:04] [V] [TRT] Tactic: 5 Time: 0.209556
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6 Time: 0.031016
[05/21/2021-07:43:04] [V] [TRT] Tactic: 56 Time: 0.052396
[05/21/2021-07:43:04] [V] [TRT] Tactic: 57 Time: 0.042392
[05/21/2021-07:43:04] [V] [TRT] Tactic: 58 Time: 0.076972
[05/21/2021-07:43:04] [V] [TRT] Tactic: 60 Time: 0.212808
[05/21/2021-07:43:04] [V] [TRT] Tactic: 61 Time: 0.208912
[05/21/2021-07:43:04] [V] [TRT] Tactic: 62 Time: 0.033536
[05/21/2021-07:43:04] [V] [TRT] Tactic: 112 Time: 0.0539
[05/21/2021-07:43:04] [V] [TRT] Tactic: 113 Time: 0.054528
[05/21/2021-07:43:04] [V] [TRT] Tactic: 114 Time: 0.104612
[05/21/2021-07:43:04] [V] [TRT] Tactic: 116 Time: 0.215148
[05/21/2021-07:43:04] [V] [TRT] Tactic: 117 Time: 0.212196
[05/21/2021-07:43:04] [V] [TRT] Tactic: 118 Time: 0.031488
[05/21/2021-07:43:04] [V] [TRT] Fastest Tactic: 6 Time: 0.031016
[05/21/2021-07:43:04] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:04] [V] [TRT] Tactic: 4549827808004681195 Time: 0.10176
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:04] [V] [TRT] Tactic: 5779835512569528575 Time: 0.130432
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6053873026024413720 Time: 0.135808
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:43:04] [V] [TRT] Tactic: 6767548733843469815 Time: 0.106752
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:04] [V] [TRT] Tactic: -6313876406580483184 Time: 0.128268
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:04] [V] [TRT] Tactic: -1123676555321336786 Time: 0.13454
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:04] [V] [TRT] Tactic: -701551393537224327 Time: 0.115712
[05/21/2021-07:43:04] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.10176
[05/21/2021-07:43:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319
[05/21/2021-07:43:04] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:43:04] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:04] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:04] [V] [TRT] Tactic: 2860655430572478466 Time: 0.077604
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:04] [V] [TRT] Tactic: 4474630279712975759 Time: 0.044172
[05/21/2021-07:43:04] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4479823862704990365 Time: 0.044476
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4696204239951173149 Time: 0.078896
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:05] [V] [TRT] Tactic: 5778138195697110003 Time: 0.1344
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:05] [V] [TRT] Tactic: 7155825427510256858 Time: 0.128384
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:05] [V] [TRT] Tactic: 8918020581761223752 Time: 0.125696
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:05] [V] [TRT] Tactic: -4756382386362004279 Time: 0.077088
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:05] [V] [TRT] Tactic: -3855385237722507464 Time: 0.135168
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:05] [V] [TRT] Tactic: -2809379259463049391 Time: 0.132224
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:05] [V] [TRT] Tactic: -504296718212024303 Time: 0.12596
[05/21/2021-07:43:05] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 0.044172
[05/21/2021-07:43:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759
[05/21/2021-07:43:05] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:43:05] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:05] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:05] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:05] [V] [TRT] Tactic: 2860655430572478466 Time: 0.077348
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4474630279712975759 Time: 0.04446
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4479823862704990365 Time: 0.043768
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4696204239951173149 Time: 0.08028
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:05] [V] [TRT] Tactic: 5778138195697110003 Time: 0.136704
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:05] [V] [TRT] Tactic: 7155825427510256858 Time: 0.12928
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:43:05] [V] [TRT] Tactic: 7342025736444949634 Time: 0.09088
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:05] [V] [TRT] Tactic: 8918020581761223752 Time: 0.125568
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:43:05] [V] [TRT] Tactic: -7377458734869418330 Time: 0.089352
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:43:05] [V] [TRT] Tactic: -5457304872213719461 Time: 0.090212
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:05] [V] [TRT] Tactic: -4756382386362004279 Time: 0.076724
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:05] [V] [TRT] Tactic: -3855385237722507464 Time: 0.135016
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:05] [V] [TRT] Tactic: -2809379259463049391 Time: 0.133784
[05/21/2021-07:43:05] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:05] [V] [TRT] Tactic: -504296718212024303 Time: 0.127016
[05/21/2021-07:43:05] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.043768
[05/21/2021-07:43:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:05] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:05] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:05] [V] [TRT] Tactic: 0 Time: 0.062976
[05/21/2021-07:43:05] [V] [TRT] Tactic: 1 Time: 0.062848
[05/21/2021-07:43:05] [V] [TRT] Tactic: 2 Time: 0.094628
[05/21/2021-07:43:05] [V] [TRT] Tactic: 4 Time: 0.2129
[05/21/2021-07:43:05] [V] [TRT] Tactic: 5 Time: 0.209636
[05/21/2021-07:43:05] [V] [TRT] Tactic: 6 Time: 0.04928
[05/21/2021-07:43:05] [V] [TRT] Tactic: 56 Time: 0.06272
[05/21/2021-07:43:05] [V] [TRT] Tactic: 58 Time: 0.09472
[05/21/2021-07:43:05] [V] [TRT] Tactic: 60 Time: 0.213044
[05/21/2021-07:43:05] [V] [TRT] Tactic: 61 Time: 0.209432
[05/21/2021-07:43:05] [V] [TRT] Tactic: 62 Time: 0.04928
[05/21/2021-07:43:05] [V] [TRT] Fastest Tactic: 6 Time: 0.04928
[05/21/2021-07:43:05] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6
[05/21/2021-07:43:05] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:43:05] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:05] [V] [TRT] Tactic: 524287 Time: 0.037128
[05/21/2021-07:43:05] [V] [TRT] Tactic: 720895 Time: 0.03178
[05/21/2021-07:43:05] [V] [TRT] Tactic: 983039 Time: 0.018408
[05/21/2021-07:43:05] [V] [TRT] Tactic: 1048575 Time: 0.02558
[05/21/2021-07:43:05] [V] [TRT] Tactic: 1703935 Time: 0.021504
[05/21/2021-07:43:05] [V] [TRT] Tactic: 1769471 Time: 0.018688
[05/21/2021-07:43:05] [V] [TRT] Tactic: 1966079 Time: 0.058368
[05/21/2021-07:43:05] [V] [TRT] Tactic: 2031615 Time: 0.050816
[05/21/2021-07:43:05] [V] [TRT] Tactic: 2228223 Time: 0.027568
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2424831 Time: 0.015464
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2621439 Time: 0.020524
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2752511 Time: 0.03492
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2818047 Time: 0.033024
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2883583 Time: 0.070784
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3014655 Time: 0.018816
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3145727 Time: 0.02112
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3473407 Time: 0.0382
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3604479 Time: 0.018944
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3735551 Time: 0.031684
[05/21/2021-07:43:06] [V] [TRT] Tactic: 4390911 Time: 0.064512
[05/21/2021-07:43:06] [V] [TRT] Tactic: 5046271 Time: 0.021504
[05/21/2021-07:43:06] [V] [TRT] Tactic: 5963775 Time: 0.055296
[05/21/2021-07:43:06] [V] [TRT] Tactic: 6160383 Time: 0.034072
[05/21/2021-07:43:06] [V] [TRT] Tactic: 6488063 Time: 0.030584
[05/21/2021-07:43:06] [V] [TRT] Tactic: 6881279 Time: 0.045184
[05/21/2021-07:43:06] [V] [TRT] Tactic: 7274495 Time: 0.015364
[05/21/2021-07:43:06] [V] [TRT] Tactic: 7864319 Time: 0.014336
[05/21/2021-07:43:06] [V] [TRT] Tactic: 7995391 Time: 0.03276
[05/21/2021-07:43:06] [V] [TRT] Tactic: 8585215 Time: 0.0433
[05/21/2021-07:43:06] [V] [TRT] Tactic: 8847359 Time: 0.015744
[05/21/2021-07:43:06] [V] [TRT] Tactic: 8978431 Time: 0.054756
[05/21/2021-07:43:06] [V] [TRT] Tactic: 9043967 Time: 0.017536
[05/21/2021-07:43:06] [V] [TRT] Tactic: 9175039 Time: 0.018696
[05/21/2021-07:43:06] [V] [TRT] Tactic: 9502719 Time: 0.064256
[05/21/2021-07:43:06] [V] [TRT] Tactic: 9830399 Time: 0.032864
[05/21/2021-07:43:06] [V] [TRT] Tactic: 9961471 Time: 0.01664
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10027007 Time: 0.023808
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10092543 Time: 0.064512
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10289151 Time: 0.059312
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10485759 Time: 0.019516
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10682367 Time: 0.02048
[05/21/2021-07:43:06] [V] [TRT] Tactic: 10813439 Time: 0.020352
[05/21/2021-07:43:06] [V] [TRT] Fastest Tactic: 7864319 Time: 0.014336
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2195670545862694453 Time: 0.066944
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3419182076704469245 Time: 0.063472
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:06] [V] [TRT] Tactic: 3891805945559659536 Time: 0.087168
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:06] [V] [TRT] Tactic: 5548126322150286555 Time: 0.060896
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:06] [V] [TRT] Tactic: 6057304366605292508 Time: 0.055296
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:43:06] [V] [TRT] Tactic: -7928611605886347652 Time: 0.091392
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:43:06] [V] [TRT] Tactic: -5172391392092686714 Time: 0.07104
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:06] [V] [TRT] Tactic: -4374269919094467161 Time: 0.053916
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953
[05/21/2021-07:43:06] [V] [TRT] Tactic: -4083394051665370953 Time: 0.016144
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:06] [V] [TRT] Tactic: -1546027692247304867 Time: 0.086272
[05/21/2021-07:43:06] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.016144
[05/21/2021-07:43:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7864319
[05/21/2021-07:43:06] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:06] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:06] [V] [TRT] Tactic: 0 Time: 0.086648
[05/21/2021-07:43:06] [V] [TRT] Tactic: 1 Time: 0.08704
[05/21/2021-07:43:06] [V] [TRT] Tactic: 2 Time: 0.124056
[05/21/2021-07:43:06] [V] [TRT] Tactic: 6 Time: 0.04096
[05/21/2021-07:43:06] [V] [TRT] Tactic: 56 Time: 0.087968
[05/21/2021-07:43:06] [V] [TRT] Tactic: 58 Time: 0.125184
[05/21/2021-07:43:06] [V] [TRT] Tactic: 62 Time: 0.04096
[05/21/2021-07:43:06] [V] [TRT] Fastest Tactic: 6 Time: 0.04096
[05/21/2021-07:43:06] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:06] [V] [TRT] Tactic: 254850674756030979 Time: 0.048256
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:43:06] [V] [TRT] Tactic: 328038211831149625 Time: 0.04708
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:43:06] [V] [TRT] Tactic: 411553864378931917 Time: 0.01652
[05/21/2021-07:43:06] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1011057357468998345 Time: 0.028588
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1156328698016730421 Time: 0.029444
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1723736032573714698 Time: 0.01614
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1832046141070096030 Time: 0.01664
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1838082074606840426 Time: 0.016384
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:07] [V] [TRT] Tactic: 1899296423087490472 Time: 0.011392
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2428167804343994714 Time: 0.016052
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2541579301352125276 Time: 0.02628
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011836
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2819719497590964443 Time: 0.01728
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2968605903460894194 Time: 0.016768
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:43:07] [V] [TRT] Tactic: 2986078304285316765 Time: 0.027232
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:07] [V] [TRT] Tactic: 3362537467505018070 Time: 0.026752
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:07] [V] [TRT] Tactic: 3513075359009385578 Time: 0.048128
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:43:07] [V] [TRT] Tactic: 3573559043797674382 Time: 0.016692
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:43:07] [V] [TRT] Tactic: 3591970081995419777 Time: 0.011076
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:07] [V] [TRT] Tactic: 3704534001553878387 Time: 0.027636
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:07] [V] [TRT] Tactic: 4278315135102886928 Time: 0.015616
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:43:07] [V] [TRT] Tactic: 4503233883285355107 Time: 0.012224
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:07] [V] [TRT] Tactic: 4802447371470387646 Time: 0.029696
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5059676457552313631 Time: 0.047688
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5368829646735632944 Time: 0.011264
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5398999388616959893 Time: 0.027952
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5746691132547383910 Time: 0.016668
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5770170567977052602 Time: 0.032128
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:43:07] [V] [TRT] Tactic: 5953552212833506549 Time: 0.0269
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:07] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01536
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:43:07] [V] [TRT] Tactic: 6074229447555668232 Time: 0.012032
[05/21/2021-07:43:07] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:43:07] [V] [TRT] Tactic: 6154447660803990543 Time: 0.015488
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6325769668000961702 Time: 0.02572
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6350273239113254096 Time: 0.009456
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0271
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6446388116965632819 Time: 0.016896
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6468794451065529747 Time: 0.01664
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6642277870194067185 Time: 0.04896
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011392
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6972489290272968208 Time: 0.027008
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:43:08] [V] [TRT] Tactic: 6979044990896381511 Time: 0.046976
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:08] [V] [TRT] Tactic: 7216571380637776659 Time: 0.032388
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:08] [V] [TRT] Tactic: 7609923741161019135 Time: 0.016244
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:43:08] [V] [TRT] Tactic: 7705739241028240201 Time: 0.011696
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:43:08] [V] [TRT] Tactic: 8072087735545283117 Time: 0.047872
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:08] [V] [TRT] Tactic: 8101703987960976805 Time: 0.012032
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:08] [V] [TRT] Tactic: 8170606396342855895 Time: 0.016768
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:08] [V] [TRT] Tactic: 8839784824303350101 Time: 0.029312
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:43:08] [V] [TRT] Tactic: -9217371357561775773 Time: 0.012288
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:08] [V] [TRT] Tactic: -9009272790678027912 Time: 0.032276
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:43:08] [V] [TRT] Tactic: -8985224497679592364 Time: 0.012928
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:43:08] [V] [TRT] Tactic: -8949544755481315679 Time: 0.017024
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:43:08] [V] [TRT] Tactic: -8759929675070720385 Time: 0.027008
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:08] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011264
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6902925267326201166 Time: 0.009344
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6840588038605932325 Time: 0.016384
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6799856376604253964 Time: 0.046136
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6625722781282978136 Time: 0.017932
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6525498856028268801 Time: 0.027776
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6356316196810535311 Time: 0.012416
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6324345858751792783 Time: 0.017792
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6262400699544994312 Time: 0.046224
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6257787336162086472 Time: 0.029824
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:08] [V] [TRT] Tactic: -6063766379489217211 Time: 0.016512
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:43:08] [V] [TRT] Tactic: -5777580938094193096 Time: 0.016632
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:43:08] [V] [TRT] Tactic: -5657273398217409378 Time: 0.0482
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:08] [V] [TRT] Tactic: -5530886555766748586 Time: 0.025728
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:43:08] [V] [TRT] Tactic: -5422685219138380548 Time: 0.015348
[05/21/2021-07:43:08] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:09] [V] [TRT] Tactic: -5161596964442251102 Time: 0.01704
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:09] [V] [TRT] Tactic: -5127240325355316006 Time: 0.015744
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4825567853927730435 Time: 0.016404
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4796511246675321840 Time: 0.017108
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4706569565442112734 Time: 0.012388
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4566599693570369588 Time: 0.027436
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4409144516525410768 Time: 0.02676
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4379519430184503304 Time: 0.01618
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4152066959007262150 Time: 0.047248
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:09] [V] [TRT] Tactic: -4021926646879732549 Time: 0.015872
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3987638434926559037 Time: 0.016416
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3905653247016903130 Time: 0.029056
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3903974568488493144 Time: 0.01808
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3895429239811098010 Time: 0.015872
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3864869056275745423 Time: 0.030208
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011076
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3412636942650049698 Time: 0.028772
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3338665856053412950 Time: 0.027296
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:09] [V] [TRT] Tactic: -3058330359340425555 Time: 0.016408
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2816084650627734155 Time: 0.032384
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2662892962457732243 Time: 0.015328
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2559894581585337900 Time: 0.047404
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2530740716768816092 Time: 0.026368
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2332828394978346992 Time: 0.027192
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2241736083352441442 Time: 0.032384
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:43:09] [V] [TRT] Tactic: -2161909437867201546 Time: 0.010504
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:09] [V] [TRT] Tactic: -1985778916402815946 Time: 0.031488
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:43:09] [V] [TRT] Tactic: -1500496213132463076 Time: 0.017456
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:09] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011392
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:43:09] [V] [TRT] Tactic: -910286698936744682 Time: 0.010368
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:43:09] [V] [TRT] Tactic: -606726295133751039 Time: 0.015808
[05/21/2021-07:43:09] [V] [TRT] Fastest Tactic: -6902925267326201166 Time: 0.009344
[05/21/2021-07:43:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6902925267326201166
[05/21/2021-07:43:09] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:09] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:09] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv2 + stage2_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:43:09] [V] [TRT] Tactic: 1301213148470244380 Time: 0.015232
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:43:09] [V] [TRT] Tactic: 2140378925901736289 Time: 0.014344
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:43:09] [V] [TRT] Tactic: 7019285522757193163 Time: 0.0192
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:43:09] [V] [TRT] Tactic: 7616509406849244401 Time: 0.014592
[05/21/2021-07:43:09] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:43:10] [V] [TRT] Tactic: -6575010824547653277 Time: 0.011776
[05/21/2021-07:43:10] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.011776
[05/21/2021-07:43:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:43:10] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudaDepthwiseConvolution)
[05/21/2021-07:43:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (FusedConvActConvolution)
[05/21/2021-07:43:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:10] [V] [TRT] Tactic: 0 Time: 0.0306
[05/21/2021-07:43:10] [V] [TRT] Tactic: 1 Time: 0.02944
[05/21/2021-07:43:10] [V] [TRT] Tactic: 2 Time: 0.072096
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4 Time: 0.745768
[05/21/2021-07:43:10] [V] [TRT] Tactic: 5 Time: 0.074304
[05/21/2021-07:43:10] [V] [TRT] Tactic: 56 Time: 0.030548
[05/21/2021-07:43:10] [V] [TRT] Tactic: 57 Time: 0.029488
[05/21/2021-07:43:10] [V] [TRT] Tactic: 58 Time: 0.072332
[05/21/2021-07:43:10] [V] [TRT] Tactic: 60 Time: 0.7469
[05/21/2021-07:43:10] [V] [TRT] Tactic: 61 Time: 0.073728
[05/21/2021-07:43:10] [V] [TRT] Tactic: 112 Time: 0.02864
[05/21/2021-07:43:10] [V] [TRT] Tactic: 113 Time: 0.02896
[05/21/2021-07:43:10] [V] [TRT] Tactic: 114 Time: 0.055188
[05/21/2021-07:43:10] [V] [TRT] Tactic: 116 Time: 0.746276
[05/21/2021-07:43:10] [V] [TRT] Tactic: 117 Time: 0.073728
[05/21/2021-07:43:10] [V] [TRT] Fastest Tactic: 112 Time: 0.02864
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4549827808004681195 Time: 0.021668
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:10] [V] [TRT] Tactic: 5779835512569528575 Time: 0.024576
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:43:10] [V] [TRT] Tactic: 9151672657204310840 Time: 0.043024
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:43:10] [V] [TRT] Tactic: -7491730084094677098 Time: 0.027768
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:43:10] [V] [TRT] Tactic: -6622064180404051845 Time: 0.04032
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:10] [V] [TRT] Tactic: -6313876406580483184 Time: 0.028272
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:43:10] [V] [TRT] Tactic: -6273689210331812572 Time: 0.02424
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:43:10] [V] [TRT] Tactic: -4337126844824617177 Time: 0.018432
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:10] [V] [TRT] Tactic: -1123676555321336786 Time: 0.022656
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:10] [V] [TRT] Tactic: -701551393537224327 Time: 0.019456
[05/21/2021-07:43:10] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.018432
[05/21/2021-07:43:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[05/21/2021-07:43:10] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:10] [V] [TRT] Tactic: 1663866669559596164 Time: 0.02676
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:10] [V] [TRT] Tactic: 2860655430572478466 Time: 0.019368
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4474630279712975759 Time: 0.020644
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4479823862704990365 Time: 0.020352
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4696204239951173149 Time: 0.01946
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:10] [V] [TRT] Tactic: 5778138195697110003 Time: 0.02626
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:10] [V] [TRT] Tactic: 8918020581761223752 Time: 0.02466
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:10] [V] [TRT] Tactic: -5905193483742532701 Time: 0.018432
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:10] [V] [TRT] Tactic: -4035591156787122265 Time: 0.017444
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:10] [V] [TRT] Tactic: -2809379259463049391 Time: 0.022528
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:10] [V] [TRT] Tactic: -1985235291706575900 Time: 0.020912
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:10] [V] [TRT] Tactic: -504296718212024303 Time: 0.025216
[05/21/2021-07:43:10] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.017444
[05/21/2021-07:43:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:10] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:10] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:10] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:43:10] [V] [TRT] Tactic: 1373022415249282411 Time: 0.020432
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:10] [V] [TRT] Tactic: 1663866669559596164 Time: 0.026056
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:10] [V] [TRT] Tactic: 2860655430572478466 Time: 0.019332
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:10] [V] [TRT] Tactic: 4474630279712975759 Time: 0.020608
[05/21/2021-07:43:10] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:11] [V] [TRT] Tactic: 4479823862704990365 Time: 0.02034
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:11] [V] [TRT] Tactic: 4696204239951173149 Time: 0.019096
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:11] [V] [TRT] Tactic: 5778138195697110003 Time: 0.022648
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:11] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0209
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:43:11] [V] [TRT] Tactic: -7067026478815706014 Time: 0.017408
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:11] [V] [TRT] Tactic: -5905193483742532701 Time: 0.018816
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:11] [V] [TRT] Tactic: -4035591156787122265 Time: 0.019996
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:11] [V] [TRT] Tactic: -2809379259463049391 Time: 0.02624
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:11] [V] [TRT] Tactic: -1985235291706575900 Time: 0.024468
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:11] [V] [TRT] Tactic: -504296718212024303 Time: 0.02496
[05/21/2021-07:43:11] [V] [TRT] Fastest Tactic: -7067026478815706014 Time: 0.017408
[05/21/2021-07:43:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7067026478815706014
[05/21/2021-07:43:11] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:11] [V] [TRT] Tactic: 0 Time: 0.018884
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1 Time: 0.018908
[05/21/2021-07:43:11] [V] [TRT] Tactic: 2 Time: 0.053724
[05/21/2021-07:43:11] [V] [TRT] Tactic: 4 Time: 0.743052
[05/21/2021-07:43:11] [V] [TRT] Tactic: 5 Time: 0.073152
[05/21/2021-07:43:11] [V] [TRT] Tactic: 56 Time: 0.018768
[05/21/2021-07:43:11] [V] [TRT] Tactic: 58 Time: 0.053532
[05/21/2021-07:43:11] [V] [TRT] Tactic: 60 Time: 0.743592
[05/21/2021-07:43:11] [V] [TRT] Tactic: 61 Time: 0.072712
[05/21/2021-07:43:11] [V] [TRT] Fastest Tactic: 56 Time: 0.018768
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:43:11] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (FusedConvActConvolution)
[05/21/2021-07:43:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:11] [V] [TRT] Tactic: 2195670545862694453 Time: 0.013324
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:11] [V] [TRT] Tactic: 3891805945559659536 Time: 0.016676
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:11] [V] [TRT] Tactic: 4418200634486186714 Time: 0.012724
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:11] [V] [TRT] Tactic: 5548126322150286555 Time: 0.013156
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:11] [V] [TRT] Tactic: 6057304366605292508 Time: 0.012928
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:11] [V] [TRT] Tactic: 7392644644614664811 Time: 0.013244
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:11] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0164
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:11] [V] [TRT] Tactic: -4374269919094467161 Time: 0.01344
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:11] [V] [TRT] Tactic: -1546027692247304867 Time: 0.016384
[05/21/2021-07:43:11] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.012724
[05/21/2021-07:43:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:43:11] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudaDepthwiseConvolution)
[05/21/2021-07:43:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:11] [V] [TRT] Tactic: 0 Time: 0.02764
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1 Time: 0.026548
[05/21/2021-07:43:11] [V] [TRT] Tactic: 2 Time: 0.05896
[05/21/2021-07:43:11] [V] [TRT] Tactic: 56 Time: 0.02762
[05/21/2021-07:43:11] [V] [TRT] Tactic: 58 Time: 0.060212
[05/21/2021-07:43:11] [V] [TRT] Fastest Tactic: 1 Time: 0.026548
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:11] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:11] [V] [TRT] Tactic: 254850674756030979 Time: 0.014224
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01088
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1362727228442059924 Time: 0.010756
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1576319725282257846 Time: 0.008832
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:11] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009036
[05/21/2021-07:43:11] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:12] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009732
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:12] [V] [TRT] Tactic: 1899296423087490472 Time: 0.011348
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:12] [V] [TRT] Tactic: 2238656696610018305 Time: 0.008844
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:12] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01024
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:12] [V] [TRT] Tactic: 2559328254295148085 Time: 0.012972
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:12] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0113
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:12] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009104
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010496
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3359475309458902373 Time: 0.007552
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01024
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3513075359009385578 Time: 0.013312
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3704534001553878387 Time: 0.010752
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:43:12] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009344
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4278315135102886928 Time: 0.008328
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008396
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008192
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4491683531415781597 Time: 0.012608
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01002
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4571819373777460444 Time: 0.013568
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4595173549602041350 Time: 0.012888
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4802447371470387646 Time: 0.010336
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:43:12] [V] [TRT] Tactic: 4993757826442493905 Time: 0.007244
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:12] [V] [TRT] Tactic: 5059676457552313631 Time: 0.013312
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:12] [V] [TRT] Tactic: 5205510332404400949 Time: 0.009216
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:12] [V] [TRT] Tactic: 5346855796032465921 Time: 0.01136
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:12] [V] [TRT] Tactic: 5398999388616959893 Time: 0.01078
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:12] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00848
[05/21/2021-07:43:12] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:13] [V] [TRT] Tactic: 6377497238381488891 Time: 0.010368
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:13] [V] [TRT] Tactic: 6468794451065529747 Time: 0.009368
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:43:13] [V] [TRT] Tactic: 6697277555581639516 Time: 0.007884
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:13] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010032
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:13] [V] [TRT] Tactic: 7216571380637776659 Time: 0.010252
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:13] [V] [TRT] Tactic: 7609923741161019135 Time: 0.008192
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:13] [V] [TRT] Tactic: 8101703987960976805 Time: 0.011136
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:13] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01024
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:13] [V] [TRT] Tactic: 8764780417487154889 Time: 0.01088
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:43:13] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00858
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:13] [V] [TRT] Tactic: 8839784824303350101 Time: 0.010452
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:43:13] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007868
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:13] [V] [TRT] Tactic: -9009272790678027912 Time: 0.011264
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:13] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01028
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:13] [V] [TRT] Tactic: -8280443484414412687 Time: 0.01344
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:13] [V] [TRT] Tactic: -8205952393017864204 Time: 0.012928
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:13] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009132
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:13] [V] [TRT] Tactic: -7410012245391920273 Time: 0.010892
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:13] [V] [TRT] Tactic: -7099920365135295801 Time: 0.007168
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:13] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009452
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:43:13] [V] [TRT] Tactic: -6768327495007644783 Time: 0.010196
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:13] [V] [TRT] Tactic: -6356316196810535311 Time: 0.011932
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:13] [V] [TRT] Tactic: -6063766379489217211 Time: 0.008576
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:13] [V] [TRT] Tactic: -5530886555766748586 Time: 0.009856
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:13] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008448
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:13] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009128
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:13] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008192
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009416
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4796511246675321840 Time: 0.009012
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4548822885169694805 Time: 0.011008
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4379519430184503304 Time: 0.008696
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4293222705763522367 Time: 0.009216
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4152066959007262150 Time: 0.013284
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:13] [V] [TRT] Tactic: -4021926646879732549 Time: 0.008192
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009364
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3905653247016903130 Time: 0.010888
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3903342530518878192 Time: 0.010764
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01088
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3601464762214218301 Time: 0.009856
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:13] [V] [TRT] Tactic: -3058330359340425555 Time: 0.00896
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:13] [V] [TRT] Tactic: -2878731503146438856 Time: 0.010412
[05/21/2021-07:43:13] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:14] [V] [TRT] Tactic: -2602982885923184927 Time: 0.01024
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:14] [V] [TRT] Tactic: -2353603993968373338 Time: 0.010536
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:14] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009216
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:14] [V] [TRT] Tactic: -2003055242756584050 Time: 0.007168
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01024
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1828674067637788567 Time: 0.01026
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1640527254204634147 Time: 0.008368
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1562548049711204899 Time: 0.009196
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1242202084391243207 Time: 0.008192
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0103
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:14] [V] [TRT] Tactic: -1038291877007553549 Time: 0.008472
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:14] [V] [TRT] Tactic: -406984317033388136 Time: 0.01024
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:14] [V] [TRT] Tactic: -331499326992534460 Time: 0.00832
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:43:14] [V] [TRT] Tactic: -206523504474952360 Time: 0.010508
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: -7099920365135295801 Time: 0.007168
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7099920365135295801
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CublasConvolution)
[05/21/2021-07:43:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit2_conv3 + _plus4 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:43:14] [V] [TRT] Tactic: 162720039126739803 Time: 0.007452
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:43:14] [V] [TRT] Tactic: 382577144988222004 Time: 0.008192
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:14] [V] [TRT] Tactic: 2334614616543277495 Time: 0.008192
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:14] [V] [TRT] Tactic: 4126996489741716394 Time: 0.007128
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:43:14] [V] [TRT] Tactic: 6197123388212233554 Time: 0.008192
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:43:14] [V] [TRT] Tactic: 6466136707377588846 Time: 0.00888
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:43:14] [V] [TRT] Tactic: 6958123061428231366 Time: 0.00786
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:14] [V] [TRT] Tactic: 8940522081427638481 Time: 0.007596
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:43:14] [V] [TRT] Tactic: -7023377647582255231 Time: 0.007404
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:43:14] [V] [TRT] Tactic: -6288137413706508928 Time: 0.008448
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:14] [V] [TRT] Tactic: -6148657501329441429 Time: 0.00768
[05/21/2021-07:43:14] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:14] [V] [TRT] Tactic: -3396930063803107917 Time: 0.008704
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 4126996489741716394 Time: 0.007128
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4126996489741716394
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.005264
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005264
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.005352
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005352
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.005352
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005352
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.006284
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006284
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_bn1 + stage2_unit3_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CublasConvolution)
[05/21/2021-07:43:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv1 + stage2_unit3_relu2 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv2 + stage2_unit3_relu3 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CublasConvolution)
[05/21/2021-07:43:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit3_conv3 + _plus5 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.006144
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.005348
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005348
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.005412
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.005412
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Tactic: 0 Time: 0.006916
[05/21/2021-07:43:14] [V] [TRT] Fastest Tactic: 0 Time: 0.006916
[05/21/2021-07:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_bn1 + stage2_unit4_relu1 (Scale)
[05/21/2021-07:43:14] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CublasConvolution)
[05/21/2021-07:43:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv1 + stage2_unit4_relu2 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128) -> Float(100352,1,3584,128) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32) -> Float(25088,1:4,896,32) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1) -> Half(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1) -> Half(50176,784:2,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Float(100352,784,28,1) ***************
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CudnnConvolution)
[05/21/2021-07:43:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv2 + stage2_unit4_relu3 (CaskConvolution)
[05/21/2021-07:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16) -> Half(12544,1:8,448,16) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8) -> Half(6272,1:16,224,8) ***************
[05/21/2021-07:43:14] [V] [TRT] *************** Autotuning format combination: Float(100352,784,28,1), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(100352,1,3584,128), Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,896,32), Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(100352,784,28,1), Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(50176,784:2,28,1), Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CudnnConvolution)
[05/21/2021-07:43:15] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CublasConvolution)
[05/21/2021-07:43:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage2_unit4_conv3 + _plus6 (CaskConvolution)
[05/21/2021-07:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,448,16), Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,224,8), Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(401408,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Tactic: 0 Time: 0.006144
[05/21/2021-07:43:15] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[05/21/2021-07:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(401408,1,14336,512) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(100352,1:4,3584,128) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(401408,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Tactic: 0 Time: 0.005416
[05/21/2021-07:43:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005416
[05/21/2021-07:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784:2,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Tactic: 0 Time: 0.00568
[05/21/2021-07:43:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00568
[05/21/2021-07:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(50176,1:8,1792,64) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Tactic: 0 Time: 0.006824
[05/21/2021-07:43:15] [V] [TRT] Fastest Tactic: 0 Time: 0.006824
[05/21/2021-07:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(25088,1:16,896,32) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_bn1 + stage3_unit1_relu1 (Scale)
[05/21/2021-07:43:15] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1) -> Float(200704,784,28,1) ***************
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:15] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:43:15] [V] [TRT] Tactic: 589823 Time: 0.128036
[05/21/2021-07:43:15] [V] [TRT] Tactic: 655359 Time: 0.081204
[05/21/2021-07:43:15] [V] [TRT] Tactic: 786431 Time: 0.0378
[05/21/2021-07:43:15] [V] [TRT] Tactic: 851967 Time: 0.033616
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1179647 Time: 0.029696
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1310719 Time: 0.056848
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1376255 Time: 0.088576
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1441791 Time: 0.035476
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1507327 Time: 0.050176
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1638399 Time: 0.032024
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1835007 Time: 0.0405
[05/21/2021-07:43:15] [V] [TRT] Tactic: 1900543 Time: 0.079744
[05/21/2021-07:43:15] [V] [TRT] Tactic: 2097151 Time: 0.030736
[05/21/2021-07:43:15] [V] [TRT] Tactic: 2162687 Time: 0.088704
[05/21/2021-07:43:15] [V] [TRT] Tactic: 2293759 Time: 0.083164
[05/21/2021-07:43:15] [V] [TRT] Tactic: 2359295 Time: 0.05124
[05/21/2021-07:43:15] [V] [TRT] Tactic: 2686975 Time: 0.08092
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3080191 Time: 0.043272
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3342335 Time: 0.049344
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3407871 Time: 0.049308
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3538943 Time: 0.036608
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3670015 Time: 0.153216
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3932159 Time: 0.069948
[05/21/2021-07:43:15] [V] [TRT] Tactic: 3997695 Time: 0.033072
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4063231 Time: 0.031384
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4194303 Time: 0.03896
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4259839 Time: 0.031372
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4325375 Time: 0.032712
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4521983 Time: 0.079108
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4587519 Time: 0.036272
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4653055 Time: 0.029404
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4915199 Time: 0.029852
[05/21/2021-07:43:15] [V] [TRT] Tactic: 4980735 Time: 0.047616
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5177343 Time: 0.029824
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5242879 Time: 0.044928
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5373951 Time: 0.03584
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5439487 Time: 0.04544
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5570559 Time: 0.048256
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5636095 Time: 0.028844
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5701631 Time: 0.071324
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5767167 Time: 0.072752
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5832703 Time: 0.046512
[05/21/2021-07:43:15] [V] [TRT] Tactic: 5898239 Time: 0.023816
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6029311 Time: 0.070672
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6225919 Time: 0.036096
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6291455 Time: 0.029696
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6422527 Time: 0.043264
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6750207 Time: 0.036608
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6815743 Time: 0.050048
[05/21/2021-07:43:16] [V] [TRT] Tactic: 6946815 Time: 0.043784
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7012351 Time: 0.030088
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7077887 Time: 0.035744
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7143423 Time: 0.0544
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7208959 Time: 0.049828
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7340031 Time: 0.026004
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7405567 Time: 0.030876
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7536639 Time: 0.070748
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7602175 Time: 0.037344
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7733247 Time: 0.034704
[05/21/2021-07:43:16] [V] [TRT] Tactic: 7798783 Time: 0.035996
[05/21/2021-07:43:16] [V] [TRT] Tactic: 8191999 Time: 0.046636
[05/21/2021-07:43:16] [V] [TRT] Tactic: 8257535 Time: 0.02944
[05/21/2021-07:43:16] [V] [TRT] Tactic: 8323071 Time: 0.038824
[05/21/2021-07:43:16] [V] [TRT] Tactic: 8650751 Time: 0.036212
[05/21/2021-07:43:16] [V] [TRT] Tactic: 8716287 Time: 0.038076
[05/21/2021-07:43:16] [V] [TRT] Tactic: 9109503 Time: 0.030192
[05/21/2021-07:43:16] [V] [TRT] Tactic: 9568255 Time: 0.030592
[05/21/2021-07:43:16] [V] [TRT] Tactic: 9895935 Time: 0.038016
[05/21/2021-07:43:16] [V] [TRT] Tactic: 10223615 Time: 0.084992
[05/21/2021-07:43:16] [V] [TRT] Tactic: 10354687 Time: 0.034688
[05/21/2021-07:43:16] [V] [TRT] Tactic: 10551295 Time: 0.053376
[05/21/2021-07:43:16] [V] [TRT] Tactic: 10747903 Time: 0.033496
[05/21/2021-07:43:16] [V] [TRT] Tactic: 10944511 Time: 0.047264
[05/21/2021-07:43:16] [V] [TRT] Fastest Tactic: 5898239 Time: 0.023816
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:16] [V] [TRT] Tactic: 0 Time: 0.038212
[05/21/2021-07:43:16] [V] [TRT] Tactic: 1 Time: 0.035488
[05/21/2021-07:43:16] [V] [TRT] Tactic: 2 Time: 0.1324
[05/21/2021-07:43:16] [V] [TRT] Tactic: 4 Time: 1.73022
[05/21/2021-07:43:16] [V] [TRT] Tactic: 5 Time: 0.124872
[05/21/2021-07:43:16] [V] [TRT] Tactic: 56 Time: 0.03772
[05/21/2021-07:43:16] [V] [TRT] Tactic: 57 Time: 0.035384
[05/21/2021-07:43:16] [V] [TRT] Tactic: 58 Time: 0.129576
[05/21/2021-07:43:16] [V] [TRT] Tactic: 60 Time: 1.73056
[05/21/2021-07:43:16] [V] [TRT] Tactic: 61 Time: 0.125056
[05/21/2021-07:43:16] [V] [TRT] Tactic: 112 Time: 0.03892
[05/21/2021-07:43:16] [V] [TRT] Tactic: 113 Time: 0.035232
[05/21/2021-07:43:16] [V] [TRT] Tactic: 114 Time: 0.129732
[05/21/2021-07:43:16] [V] [TRT] Tactic: 116 Time: 1.72864
[05/21/2021-07:43:16] [V] [TRT] Tactic: 117 Time: 0.125708
[05/21/2021-07:43:16] [V] [TRT] Fastest Tactic: 113 Time: 0.035232
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:16] [V] [TRT] Tactic: 4549827808004681195 Time: 0.049924
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:16] [V] [TRT] Tactic: 5779835512569528575 Time: 0.062464
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:43:16] [V] [TRT] Tactic: 9151672657204310840 Time: 0.058132
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:43:16] [V] [TRT] Tactic: -7491730084094677098 Time: 0.078368
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:43:16] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0566
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:16] [V] [TRT] Tactic: -6313876406580483184 Time: 0.06518
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:43:16] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0621
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:43:16] [V] [TRT] Tactic: -4337126844824617177 Time: 0.047532
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:16] [V] [TRT] Tactic: -1123676555321336786 Time: 0.062592
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:16] [V] [TRT] Tactic: -701551393537224327 Time: 0.05248
[05/21/2021-07:43:16] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.047532
[05/21/2021-07:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239
[05/21/2021-07:43:16] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512) -> Float(200704,1,7168,256) ***************
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:16] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:16] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:16] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:17] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06528
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:17] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038432
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023836
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023668
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4696204239951173149 Time: 0.037888
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:17] [V] [TRT] Tactic: 5778138195697110003 Time: 0.068608
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:17] [V] [TRT] Tactic: 8918020581761223752 Time: 0.06068
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:17] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0352
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:17] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023984
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:17] [V] [TRT] Tactic: -2809379259463049391 Time: 0.065408
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:17] [V] [TRT] Tactic: -1985235291706575900 Time: 0.06008
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:17] [V] [TRT] Tactic: -504296718212024303 Time: 0.060832
[05/21/2021-07:43:17] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.023668
[05/21/2021-07:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:17] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128) -> Float(50176,1:4,1792,64) ***************
[05/21/2021-07:43:17] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:17] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:17] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:17] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:43:17] [V] [TRT] Tactic: 1373022415249282411 Time: 0.046876
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:17] [V] [TRT] Tactic: 1663866669559596164 Time: 0.063596
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:17] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038448
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023708
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023572
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:17] [V] [TRT] Tactic: 4696204239951173149 Time: 0.039424
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:17] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06728
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:17] [V] [TRT] Tactic: 8918020581761223752 Time: 0.059932
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:43:17] [V] [TRT] Tactic: -7067026478815706014 Time: 0.045744
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:17] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034976
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:17] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023828
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:17] [V] [TRT] Tactic: -2809379259463049391 Time: 0.064408
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:17] [V] [TRT] Tactic: -1985235291706575900 Time: 0.059264
[05/21/2021-07:43:17] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:17] [V] [TRT] Tactic: -504296718212024303 Time: 0.059704
[05/21/2021-07:43:17] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.023572
[05/21/2021-07:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:17] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1) -> Half(200704,784,28,1) ***************
[05/21/2021-07:43:17] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:17] [V] [TRT] Tactic: 0 Time: 0.040776
[05/21/2021-07:43:17] [V] [TRT] Tactic: 1 Time: 0.049964
[05/21/2021-07:43:17] [V] [TRT] Tactic: 2 Time: 0.139136
[05/21/2021-07:43:18] [V] [TRT] Tactic: 4 Time: 1.43946
[05/21/2021-07:43:18] [V] [TRT] Tactic: 5 Time: 0.124224
[05/21/2021-07:43:18] [V] [TRT] Tactic: 56 Time: 0.041728
[05/21/2021-07:43:18] [V] [TRT] Tactic: 58 Time: 0.107404
[05/21/2021-07:43:18] [V] [TRT] Tactic: 60 Time: 1.4376
[05/21/2021-07:43:18] [V] [TRT] Tactic: 61 Time: 0.124988
[05/21/2021-07:43:18] [V] [TRT] Fastest Tactic: 0 Time: 0.040776
[05/21/2021-07:43:18] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:18] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:43:18] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(200704,784,28,1) ***************
[05/21/2021-07:43:18] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:18] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1) -> Half(100352,784:2,28,1) ***************
[05/21/2021-07:43:18] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:43:18] [V] [TRT] Tactic: 589823 Time: 0.060452
[05/21/2021-07:43:18] [V] [TRT] Tactic: 655359 Time: 0.044672
[05/21/2021-07:43:18] [V] [TRT] Tactic: 786431 Time: 0.021816
[05/21/2021-07:43:18] [V] [TRT] Tactic: 851967 Time: 0.023824
[05/21/2021-07:43:18] [V] [TRT] Tactic: 1179647 Time: 0.017856
[05/21/2021-07:43:18] [V] [TRT] Tactic: 1310719 Time: 0.033792
[05/21/2021-07:43:18] [V] [TRT] Tactic: 1376255 Time: 0.046472
[05/21/2021-07:43:18] [V] [TRT] Tactic: 1441791 Time: 0.01872
[05/21/2021-07:43:18] [V] [TRT] Tactic: 1507327 Time: 0.02816
[05/21/2021-07:43:19] [V] [TRT] Tactic: 1638399 Time: 0.018036
[05/21/2021-07:43:19] [V] [TRT] Tactic: 1835007 Time: 0.02306
[05/21/2021-07:43:19] [V] [TRT] Tactic: 1900543 Time: 0.048128
[05/21/2021-07:43:19] [V] [TRT] Tactic: 2097151 Time: 0.018048
[05/21/2021-07:43:19] [V] [TRT] Tactic: 2162687 Time: 0.047104
[05/21/2021-07:43:19] [V] [TRT] Tactic: 2293759 Time: 0.04318
[05/21/2021-07:43:19] [V] [TRT] Tactic: 2359295 Time: 0.027648
[05/21/2021-07:43:19] [V] [TRT] Tactic: 2686975 Time: 0.043008
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3080191 Time: 0.024628
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3342335 Time: 0.02894
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3407871 Time: 0.02666
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3538943 Time: 0.020864
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3670015 Time: 0.081964
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3932159 Time: 0.037932
[05/21/2021-07:43:19] [V] [TRT] Tactic: 3997695 Time: 0.019328
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4063231 Time: 0.01856
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4194303 Time: 0.021408
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4259839 Time: 0.018068
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4325375 Time: 0.018044
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4521983 Time: 0.043008
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4587519 Time: 0.0192
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4653055 Time: 0.0183
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4915199 Time: 0.017408
[05/21/2021-07:43:19] [V] [TRT] Tactic: 4980735 Time: 0.024468
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5177343 Time: 0.018176
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5242879 Time: 0.025284
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5373951 Time: 0.020136
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5439487 Time: 0.025472
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5570559 Time: 0.027648
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5636095 Time: 0.018304
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5701631 Time: 0.04032
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5767167 Time: 0.038784
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5832703 Time: 0.02728
[05/21/2021-07:43:19] [V] [TRT] Tactic: 5898239 Time: 0.018944
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6029311 Time: 0.04032
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6225919 Time: 0.019968
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6291455 Time: 0.017808
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6422527 Time: 0.02376
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6750207 Time: 0.021148
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6815743 Time: 0.027412
[05/21/2021-07:43:19] [V] [TRT] Tactic: 6946815 Time: 0.024868
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7012351 Time: 0.018176
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7077887 Time: 0.019968
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7143423 Time: 0.029904
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7208959 Time: 0.026896
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7340031 Time: 0.018304
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7405567 Time: 0.018304
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7536639 Time: 0.036992
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7602175 Time: 0.021504
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7733247 Time: 0.01842
[05/21/2021-07:43:19] [V] [TRT] Tactic: 7798783 Time: 0.021504
[05/21/2021-07:43:19] [V] [TRT] Tactic: 8191999 Time: 0.024192
[05/21/2021-07:43:19] [V] [TRT] Tactic: 8257535 Time: 0.01642
[05/21/2021-07:43:19] [V] [TRT] Tactic: 8323071 Time: 0.022528
[05/21/2021-07:43:19] [V] [TRT] Tactic: 8650751 Time: 0.021504
[05/21/2021-07:43:19] [V] [TRT] Tactic: 8716287 Time: 0.022832
[05/21/2021-07:43:19] [V] [TRT] Tactic: 9109503 Time: 0.017832
[05/21/2021-07:43:19] [V] [TRT] Tactic: 9568255 Time: 0.01728
[05/21/2021-07:43:19] [V] [TRT] Tactic: 9895935 Time: 0.021132
[05/21/2021-07:43:19] [V] [TRT] Tactic: 10223615 Time: 0.043264
[05/21/2021-07:43:19] [V] [TRT] Tactic: 10354687 Time: 0.017792
[05/21/2021-07:43:19] [V] [TRT] Tactic: 10551295 Time: 0.028968
[05/21/2021-07:43:19] [V] [TRT] Tactic: 10747903 Time: 0.018092
[05/21/2021-07:43:20] [V] [TRT] Tactic: 10944511 Time: 0.024064
[05/21/2021-07:43:20] [V] [TRT] Fastest Tactic: 8257535 Time: 0.01642
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2195670545862694453 Time: 0.029696
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0416
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:20] [V] [TRT] Tactic: 4418200634486186714 Time: 0.027136
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:20] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:20] [V] [TRT] Tactic: 6057304366605292508 Time: 0.028032
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:20] [V] [TRT] Tactic: 7392644644614664811 Time: 0.027264
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:20] [V] [TRT] Tactic: -4884039206922900293 Time: 0.041376
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:20] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028032
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:20] [V] [TRT] Tactic: -1546027692247304867 Time: 0.042296
[05/21/2021-07:43:20] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.027136
[05/21/2021-07:43:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8257535
[05/21/2021-07:43:20] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Float(200704,784,28,1) ***************
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64) -> Half(25088,1:8,896,32) ***************
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:43:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:20] [V] [TRT] Tactic: 0 Time: 0.058808
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1 Time: 0.055296
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2 Time: 0.11306
[05/21/2021-07:43:20] [V] [TRT] Tactic: 56 Time: 0.059936
[05/21/2021-07:43:20] [V] [TRT] Tactic: 58 Time: 0.116144
[05/21/2021-07:43:20] [V] [TRT] Fastest Tactic: 1 Time: 0.055296
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:20] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:20] [V] [TRT] Tactic: 254850674756030979 Time: 0.025712
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1156328698016730421 Time: 0.016924
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1362727228442059924 Time: 0.018304
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011816
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011648
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011264
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:20] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009216
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2238656696610018305 Time: 0.011128
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2541579301352125276 Time: 0.017076
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025728
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009744
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:20] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011488
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012172
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011684
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3362537467505018070 Time: 0.015876
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3513075359009385578 Time: 0.026264
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016384
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:43:20] [V] [TRT] Tactic: 3899310434460415852 Time: 0.008192
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:20] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01054
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:43:20] [V] [TRT] Tactic: 4370476717970497892 Time: 0.01028
[05/21/2021-07:43:20] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4480294673430783793 Time: 0.01094
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4491683531415781597 Time: 0.02512
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4528997467275241200 Time: 0.015924
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025728
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4595173549602041350 Time: 0.025088
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4802447371470387646 Time: 0.018176
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:43:21] [V] [TRT] Tactic: 4993757826442493905 Time: 0.010496
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:21] [V] [TRT] Tactic: 5059676457552313631 Time: 0.025472
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:21] [V] [TRT] Tactic: 5205510332404400949 Time: 0.01536
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:21] [V] [TRT] Tactic: 5346855796032465921 Time: 0.015352
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:21] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016516
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:21] [V] [TRT] Tactic: 6034364043891107501 Time: 0.010724
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:21] [V] [TRT] Tactic: 6377497238381488891 Time: 0.015908
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:21] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011944
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:43:21] [V] [TRT] Tactic: 6697277555581639516 Time: 0.01038
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:21] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008784
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:21] [V] [TRT] Tactic: 7216571380637776659 Time: 0.018816
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:21] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011008
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:21] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009212
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:21] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011392
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:21] [V] [TRT] Tactic: 8764780417487154889 Time: 0.016372
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:43:21] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010264
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:21] [V] [TRT] Tactic: 8839784824303350101 Time: 0.018176
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:43:21] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00896
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:21] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018972
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:21] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009216
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:21] [V] [TRT] Tactic: -8280443484414412687 Time: 0.025304
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:21] [V] [TRT] Tactic: -8205952393017864204 Time: 0.025008
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:21] [V] [TRT] Tactic: -8131857373260504832 Time: 0.01168
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:21] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00924
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:21] [V] [TRT] Tactic: -7099920365135295801 Time: 0.010424
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:21] [V] [TRT] Tactic: -7089118800560870395 Time: 0.008348
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:43:21] [V] [TRT] Tactic: -6768327495007644783 Time: 0.014592
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:21] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009244
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:21] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011264
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:21] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016032
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:21] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008984
[05/21/2021-07:43:21] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:22] [V] [TRT] Tactic: -5161596964442251102 Time: 0.011264
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:22] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010368
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0087
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4796511246675321840 Time: 0.011664
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4548822885169694805 Time: 0.009
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4379519430184503304 Time: 0.010752
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4293222705763522367 Time: 0.008476
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0256
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:22] [V] [TRT] Tactic: -4021926646879732549 Time: 0.010624
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011352
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3905653247016903130 Time: 0.016556
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3903342530518878192 Time: 0.017536
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01766
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008704
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:22] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011212
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:22] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016256
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:22] [V] [TRT] Tactic: -2602982885923184927 Time: 0.01578
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:22] [V] [TRT] Tactic: -2353603993968373338 Time: 0.017936
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:22] [V] [TRT] Tactic: -2032577876140256150 Time: 0.01152
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:22] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010368
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1985778916402815946 Time: 0.017908
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1828674067637788567 Time: 0.011392
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011008
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0147
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1242202084391243207 Time: 0.011052
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009228
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:22] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011212
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:22] [V] [TRT] Tactic: -406984317033388136 Time: 0.016012
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:22] [V] [TRT] Tactic: -331499326992534460 Time: 0.010496
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:43:22] [V] [TRT] Tactic: -206523504474952360 Time: 0.016384
[05/21/2021-07:43:22] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.008192
[05/21/2021-07:43:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[05/21/2021-07:43:22] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32) -> Half(12544,1:16,448,16) ***************
[05/21/2021-07:43:22] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:43:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:22] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CublasConvolution)
[05/21/2021-07:43:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:22] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv1 + stage3_unit1_relu2 (CaskConvolution)
[05/21/2021-07:43:22] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:43:23] [V] [TRT] Tactic: 162720039126739803 Time: 0.008628
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:43:23] [V] [TRT] Tactic: 382577144988222004 Time: 0.011136
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:23] [V] [TRT] Tactic: 2334614616543277495 Time: 0.010204
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:23] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008352
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1_no_preds Tactic: 6197123388212233554
[05/21/2021-07:43:23] [V] [TRT] Tactic: 6197123388212233554 Time: 0.009216
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:43:23] [V] [TRT] Tactic: 6466136707377588846 Time: 0.009472
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:43:23] [V] [TRT] Tactic: 6958123061428231366 Time: 0.00852
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:23] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008704
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:43:23] [V] [TRT] Tactic: -7023377647582255231 Time: 0.007808
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1_no_preds Tactic: -6288137413706508928
[05/21/2021-07:43:23] [V] [TRT] Tactic: -6288137413706508928 Time: 0.009376
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:23] [V] [TRT] Tactic: -6148657501329441429 Time: 0.008192
[05/21/2021-07:43:23] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:23] [V] [TRT] Tactic: -3396930063803107917 Time: 0.009332
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: -7023377647582255231 Time: 0.007808
[05/21/2021-07:43:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7023377647582255231
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:23] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:43:23] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007168
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:23] [V] [TRT] Tactic: 1002 Time: 0.010496
[05/21/2021-07:43:23] [V] [TRT] Tactic: 0 Time: 0.00768
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00768
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:23] [V] [TRT] Tactic: 1002 Time: 0.008008
[05/21/2021-07:43:23] [V] [TRT] Tactic: 0 Time: 0.005632
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: 0 Time: 0.005632
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:23] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:43:23] [V] [TRT] Tactic: 0 Time: 0.004508
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004508
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:23] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:23] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:43:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:43:23] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,784,28,1) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.007216
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.011392
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.006912
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006912
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.009472
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007336
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.0067
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0067
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007452
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.006432
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006432
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,7168,256) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.01024
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.006704
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006704
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.009728
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007596
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.006784
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006784
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007872
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,1792,64) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006784
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005828
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005828
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.008208
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005288
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005288
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.0064
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0064
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.00936
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004588
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004588
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.008712
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004384
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004384
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,784,28,1) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.008704
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.007228
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.007228
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.00896
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007936
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007448
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.006152
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006152
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.011792
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004232
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004232
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007684
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,784:2,28,1) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.00548
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00548
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.007432
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004084
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004084
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005216
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005216
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.00962
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.00772
[05/21/2021-07:43:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,896,32) -> Half(12544,1:16,448,16) (Reformat)
[05/21/2021-07:43:24] [V] [TRT] Tactic: 1002 Time: 0.00658
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(200704,784,28,1) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.008172
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.007024
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.007024
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(200704,1,7168,256) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.0067
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.005112
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005112
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Float(50176,1:4,1792,64) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.005236
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005236
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(200704,784,28,1) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.006596
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.006596
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(100352,784:2,28,1) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.006692
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.006692
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,448,16) -> Half(25088,1:8,896,32) (Reformat)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:43:25] [V] [TRT] *************** Autotuning format combination: Float(200704,784,28,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 458751 Time: 0.1571
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 458751 Time: 0.1571
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:25] [V] [TRT] Tactic: 0 Time: 0.135936
[05/21/2021-07:43:25] [V] [TRT] Tactic: 1 Time: 0.070872
[05/21/2021-07:43:25] [V] [TRT] Tactic: 2 Time: 0.166376
[05/21/2021-07:43:25] [V] [TRT] Tactic: 5 Time: 0.74904
[05/21/2021-07:43:25] [V] [TRT] Tactic: 56 Time: 0.134128
[05/21/2021-07:43:25] [V] [TRT] Tactic: 57 Time: 0.070656
[05/21/2021-07:43:25] [V] [TRT] Tactic: 58 Time: 0.166116
[05/21/2021-07:43:25] [V] [TRT] Tactic: 61 Time: 0.747904
[05/21/2021-07:43:25] [V] [TRT] Tactic: 112 Time: 0.135168
[05/21/2021-07:43:25] [V] [TRT] Tactic: 113 Time: 0.13504
[05/21/2021-07:43:25] [V] [TRT] Tactic: 114 Time: 0.166528
[05/21/2021-07:43:25] [V] [TRT] Tactic: 117 Time: 0.748216
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 57 Time: 0.070656
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:25] [V] [TRT] Tactic: 4549827808004681195 Time: 0.196864
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:25] [V] [TRT] Tactic: 5779835512569528575 Time: 0.251292
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:43:25] [V] [TRT] Tactic: 6053873026024413720 Time: 0.255504
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:43:25] [V] [TRT] Tactic: 6767548733843469815 Time: 0.19968
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:25] [V] [TRT] Tactic: -6313876406580483184 Time: 0.302544
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:25] [V] [TRT] Tactic: -1123676555321336786 Time: 0.253696
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:25] [V] [TRT] Tactic: -701551393537224327 Time: 0.218112
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.196864
[05/21/2021-07:43:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 57
[05/21/2021-07:43:25] [V] [TRT] *************** Autotuning format combination: Float(200704,1,7168,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:25] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:25] [V] [TRT] Tactic: 2860655430572478466 Time: 0.148104
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:25] [V] [TRT] Tactic: 4474630279712975759 Time: 0.08154
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:25] [V] [TRT] Tactic: 4479823862704990365 Time: 0.080712
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:25] [V] [TRT] Tactic: 4696204239951173149 Time: 0.147224
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:25] [V] [TRT] Tactic: 5778138195697110003 Time: 0.268408
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:25] [V] [TRT] Tactic: 7155825427510256858 Time: 0.248064
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:25] [V] [TRT] Tactic: 8918020581761223752 Time: 0.242724
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:25] [V] [TRT] Tactic: -4756382386362004279 Time: 0.14592
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:25] [V] [TRT] Tactic: -3855385237722507464 Time: 0.27008
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:25] [V] [TRT] Tactic: -2809379259463049391 Time: 0.26474
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:25] [V] [TRT] Tactic: -504296718212024303 Time: 0.243884
[05/21/2021-07:43:25] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.080712
[05/21/2021-07:43:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:25] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,1792,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:25] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:25] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:25] [V] [TRT] Tactic: 2860655430572478466 Time: 0.148224
[05/21/2021-07:43:25] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:26] [V] [TRT] Tactic: 4474630279712975759 Time: 0.08192
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:26] [V] [TRT] Tactic: 4479823862704990365 Time: 0.080792
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:26] [V] [TRT] Tactic: 4696204239951173149 Time: 0.148224
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:26] [V] [TRT] Tactic: 5778138195697110003 Time: 0.26586
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:26] [V] [TRT] Tactic: 7155825427510256858 Time: 0.246316
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:43:26] [V] [TRT] Tactic: 7342025736444949634 Time: 0.167936
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:26] [V] [TRT] Tactic: 8918020581761223752 Time: 0.24348
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:43:26] [V] [TRT] Tactic: -7377458734869418330 Time: 0.17242
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:43:26] [V] [TRT] Tactic: -5457304872213719461 Time: 0.171816
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:26] [V] [TRT] Tactic: -4756382386362004279 Time: 0.145912
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:26] [V] [TRT] Tactic: -3855385237722507464 Time: 0.269952
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:26] [V] [TRT] Tactic: -2809379259463049391 Time: 0.264824
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:26] [V] [TRT] Tactic: -504296718212024303 Time: 0.243888
[05/21/2021-07:43:26] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.080792
[05/21/2021-07:43:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:26] [V] [TRT] *************** Autotuning format combination: Half(200704,784,28,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:26] [V] [TRT] Tactic: 0 Time: 0.115456
[05/21/2021-07:43:26] [V] [TRT] Tactic: 1 Time: 0.116224
[05/21/2021-07:43:26] [V] [TRT] Tactic: 2 Time: 0.147712
[05/21/2021-07:43:26] [V] [TRT] Tactic: 5 Time: 0.736868
[05/21/2021-07:43:26] [V] [TRT] Tactic: 56 Time: 0.11264
[05/21/2021-07:43:26] [V] [TRT] Tactic: 58 Time: 0.139264
[05/21/2021-07:43:26] [V] [TRT] Tactic: 61 Time: 0.73452
[05/21/2021-07:43:26] [V] [TRT] Fastest Tactic: 56 Time: 0.11264
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:43:26] [V] [TRT] *************** Autotuning format combination: Half(100352,784:2,28,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:26] [V] [TRT] Tactic: 458751 Time: 0.078848
[05/21/2021-07:43:26] [V] [TRT] Fastest Tactic: 458751 Time: 0.078848
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:26] [V] [TRT] Tactic: 2195670545862694453 Time: 0.120968
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:43:26] [V] [TRT] Tactic: 3419182076704469245 Time: 0.116352
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:26] [V] [TRT] Tactic: 3891805945559659536 Time: 0.165248
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:26] [V] [TRT] Tactic: 5548126322150286555 Time: 0.112036
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:26] [V] [TRT] Tactic: 6057304366605292508 Time: 0.101408
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:43:26] [V] [TRT] Tactic: -7928611605886347652 Time: 0.170664
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:43:26] [V] [TRT] Tactic: -5172391392092686714 Time: 0.126116
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:26] [V] [TRT] Tactic: -4374269919094467161 Time: 0.102272
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:26] [V] [TRT] Tactic: -1546027692247304867 Time: 0.16478
[05/21/2021-07:43:26] [V] [TRT] Fastest Tactic: 6057304366605292508 Time: 0.101408
[05/21/2021-07:43:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751
[05/21/2021-07:43:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,896,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:26] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:26] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,896,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:26] [V] [TRT] Tactic: 0 Time: 0.129024
[05/21/2021-07:43:26] [V] [TRT] Tactic: 1 Time: 0.129024
[05/21/2021-07:43:26] [V] [TRT] Tactic: 2 Time: 0.152192
[05/21/2021-07:43:26] [V] [TRT] Tactic: 56 Time: 0.130816
[05/21/2021-07:43:26] [V] [TRT] Tactic: 58 Time: 0.14016
[05/21/2021-07:43:26] [V] [TRT] Fastest Tactic: 0 Time: 0.129024
[05/21/2021-07:43:26] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:26] [V] [TRT] Tactic: 254850674756030979 Time: 0.08632
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:43:26] [V] [TRT] Tactic: 328038211831149625 Time: 0.085072
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:43:26] [V] [TRT] Tactic: 411553864378931917 Time: 0.026368
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:43:26] [V] [TRT] Tactic: 1011057357468998345 Time: 0.049432
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:26] [V] [TRT] Tactic: 1156328698016730421 Time: 0.052276
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:43:26] [V] [TRT] Tactic: 1723736032573714698 Time: 0.024576
[05/21/2021-07:43:26] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:27] [V] [TRT] Tactic: 1832046141070096030 Time: 0.026612
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:27] [V] [TRT] Tactic: 1838082074606840426 Time: 0.026008
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:27] [V] [TRT] Tactic: 1899296423087490472 Time: 0.016896
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2428167804343994714 Time: 0.027524
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2541579301352125276 Time: 0.047536
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2657157263811141609 Time: 0.016916
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2819719497590964443 Time: 0.027564
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2968605903460894194 Time: 0.026624
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:43:27] [V] [TRT] Tactic: 2986078304285316765 Time: 0.048896
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:27] [V] [TRT] Tactic: 3362537467505018070 Time: 0.045312
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:27] [V] [TRT] Tactic: 3513075359009385578 Time: 0.087192
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:43:27] [V] [TRT] Tactic: 3573559043797674382 Time: 0.026868
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:43:27] [V] [TRT] Tactic: 3591970081995419777 Time: 0.015656
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:27] [V] [TRT] Tactic: 3704534001553878387 Time: 0.048768
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:27] [V] [TRT] Tactic: 4278315135102886928 Time: 0.026112
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:43:27] [V] [TRT] Tactic: 4503233883285355107 Time: 0.019588
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:27] [V] [TRT] Tactic: 4802447371470387646 Time: 0.050304
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5059676457552313631 Time: 0.085504
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5368829646735632944 Time: 0.017448
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5398999388616959893 Time: 0.048532
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5746691132547383910 Time: 0.027008
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5770170567977052602 Time: 0.052368
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:43:27] [V] [TRT] Tactic: 5953552212833506549 Time: 0.044404
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:27] [V] [TRT] Tactic: 6034364043891107501 Time: 0.025584
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:43:27] [V] [TRT] Tactic: 6074229447555668232 Time: 0.0174
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:43:27] [V] [TRT] Tactic: 6154447660803990543 Time: 0.025048
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:43:27] [V] [TRT] Tactic: 6325769668000961702 Time: 0.046652
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:43:27] [V] [TRT] Tactic: 6350273239113254096 Time: 0.012512
[05/21/2021-07:43:27] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6377497238381488891 Time: 0.045056
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6446388116965632819 Time: 0.026616
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6468794451065529747 Time: 0.026644
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6642277870194067185 Time: 0.090568
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6859477213531075460 Time: 0.016896
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6972489290272968208 Time: 0.046336
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:43:28] [V] [TRT] Tactic: 6979044990896381511 Time: 0.085132
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:28] [V] [TRT] Tactic: 7216571380637776659 Time: 0.058368
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:28] [V] [TRT] Tactic: 7609923741161019135 Time: 0.026496
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:43:28] [V] [TRT] Tactic: 7705739241028240201 Time: 0.0174
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:43:28] [V] [TRT] Tactic: 8072087735545283117 Time: 0.086016
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:28] [V] [TRT] Tactic: 8101703987960976805 Time: 0.017408
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:28] [V] [TRT] Tactic: 8170606396342855895 Time: 0.027392
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:28] [V] [TRT] Tactic: 8839784824303350101 Time: 0.05376
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:43:28] [V] [TRT] Tactic: -9217371357561775773 Time: 0.01786
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:28] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0544
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:43:28] [V] [TRT] Tactic: -8985224497679592364 Time: 0.020008
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:43:28] [V] [TRT] Tactic: -8949544755481315679 Time: 0.027648
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:43:28] [V] [TRT] Tactic: -8759929675070720385 Time: 0.04684
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:28] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01728
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:43:28] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013868
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:43:28] [V] [TRT] Tactic: -6840588038605932325 Time: 0.026092
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:43:28] [V] [TRT] Tactic: -6799856376604253964 Time: 0.084096
[05/21/2021-07:43:28] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6625722781282978136 Time: 0.0256
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6525498856028268801 Time: 0.045688
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6356316196810535311 Time: 0.018304
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6324345858751792783 Time: 0.027672
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6262400699544994312 Time: 0.085248
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6257787336162086472 Time: 0.05264
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:29] [V] [TRT] Tactic: -6063766379489217211 Time: 0.02678
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5777580938094193096 Time: 0.02752
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5657273398217409378 Time: 0.08696
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5530886555766748586 Time: 0.04718
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5422685219138380548 Time: 0.025876
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5161596964442251102 Time: 0.025728
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:29] [V] [TRT] Tactic: -5127240325355316006 Time: 0.02556
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4825567853927730435 Time: 0.025004
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4796511246675321840 Time: 0.026624
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4706569565442112734 Time: 0.018304
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4566599693570369588 Time: 0.04688
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4409144516525410768 Time: 0.046464
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4379519430184503304 Time: 0.026196
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4152066959007262150 Time: 0.087296
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:29] [V] [TRT] Tactic: -4021926646879732549 Time: 0.02646
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3987638434926559037 Time: 0.026836
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3905653247016903130 Time: 0.049708
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3903974568488493144 Time: 0.028652
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3895429239811098010 Time: 0.025592
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0482
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3601464762214218301 Time: 0.016788
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3412636942650049698 Time: 0.05046
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3338665856053412950 Time: 0.046756
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:29] [V] [TRT] Tactic: -3058330359340425555 Time: 0.026496
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2816084650627734155 Time: 0.05396
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2662892962457732243 Time: 0.026188
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2559894581585337900 Time: 0.086156
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2530740716768816092 Time: 0.045064
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2332828394978346992 Time: 0.045056
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2241736083352441442 Time: 0.057696
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:43:29] [V] [TRT] Tactic: -2161909437867201546 Time: 0.01536
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:29] [V] [TRT] Tactic: -1985778916402815946 Time: 0.05048
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:43:29] [V] [TRT] Tactic: -1500496213132463076 Time: 0.028596
[05/21/2021-07:43:29] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:30] [V] [TRT] Tactic: -1099247066487349374 Time: 0.017168
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:43:30] [V] [TRT] Tactic: -910286698936744682 Time: 0.016384
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:43:30] [V] [TRT] Tactic: -606726295133751039 Time: 0.026916
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 6350273239113254096 Time: 0.012512
[05/21/2021-07:43:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6350273239113254096
[05/21/2021-07:43:30] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,448,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:43:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv2 + stage3_unit1_relu3 (CaskConvolution)
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1301213148470244380 Time: 0.023544
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:43:30] [V] [TRT] Tactic: 2140378925901736289 Time: 0.022304
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:43:30] [V] [TRT] Tactic: 7019285522757193163 Time: 0.030836
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:43:30] [V] [TRT] Tactic: 7616509406849244401 Time: 0.023296
[05/21/2021-07:43:30] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:43:30] [V] [TRT] Tactic: -6575010824547653277 Time: 0.01664
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.01664
[05/21/2021-07:43:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.01028
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.01024
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.015616
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.007152
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.003804
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003804
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006316
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,196,14,1) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.00622
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.0107
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004552
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004552
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006784
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004412
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004412
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004544
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004544
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.005248
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004068
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004068
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1,3584,256) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.011008
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004848
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004848
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004832
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004832
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006616
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006188
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Float(12544,1:4,896,64) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.015772
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.003584
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003584
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004596
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004596
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004696
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004696
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.010368
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.003852
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.003852
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.008448
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196,14,1) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.00808
[05/21/2021-07:43:30] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:30] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:30] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.003712
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003712
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.0086
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.00454
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00454
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.003632
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003632
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004156
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004156
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,196:2,14,1) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.007096
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.00584
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004088
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004088
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.005516
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.00414
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00414
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.008612
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.003884
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.003884
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:8,448,32) -> Half(3136,1:16,224,16) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(50176,196,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.007104
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004944
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004944
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(50176,1,3584,256) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Float(12544,1:4,896,64) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(50176,196,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(25088,196:2,14,1) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.007
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:16,224,16) -> Half(6272,1:8,448,32) (Reformat)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:31] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:31] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:31] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:43:31] [V] [TRT] Tactic: 589823 Time: 0.062456
[05/21/2021-07:43:31] [V] [TRT] Tactic: 655359 Time: 0.041312
[05/21/2021-07:43:31] [V] [TRT] Tactic: 786431 Time: 0.022656
[05/21/2021-07:43:31] [V] [TRT] Tactic: 851967 Time: 0.020624
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1179647 Time: 0.020468
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1310719 Time: 0.032512
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1376255 Time: 0.045336
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1441791 Time: 0.022152
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1507327 Time: 0.029488
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1638399 Time: 0.024948
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1835007 Time: 0.02556
[05/21/2021-07:43:31] [V] [TRT] Tactic: 1900543 Time: 0.045456
[05/21/2021-07:43:31] [V] [TRT] Tactic: 2097151 Time: 0.021504
[05/21/2021-07:43:31] [V] [TRT] Tactic: 2162687 Time: 0.045
[05/21/2021-07:43:32] [V] [TRT] Tactic: 2293759 Time: 0.042816
[05/21/2021-07:43:32] [V] [TRT] Tactic: 2359295 Time: 0.029056
[05/21/2021-07:43:32] [V] [TRT] Tactic: 2686975 Time: 0.044288
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3080191 Time: 0.025536
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3342335 Time: 0.028908
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3407871 Time: 0.028716
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3538943 Time: 0.022536
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3670015 Time: 0.07372
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3932159 Time: 0.038912
[05/21/2021-07:43:32] [V] [TRT] Tactic: 3997695 Time: 0.020608
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4063231 Time: 0.019988
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4194303 Time: 0.02368
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4259839 Time: 0.021864
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4325375 Time: 0.023936
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4521983 Time: 0.042928
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4587519 Time: 0.022176
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4653055 Time: 0.018688
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4915199 Time: 0.021052
[05/21/2021-07:43:32] [V] [TRT] Tactic: 4980735 Time: 0.0288
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5177343 Time: 0.025472
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5242879 Time: 0.027012
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5373951 Time: 0.021896
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5439487 Time: 0.024448
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5570559 Time: 0.02782
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5636095 Time: 0.019456
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5701631 Time: 0.04096
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5767167 Time: 0.032684
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5832703 Time: 0.028448
[05/21/2021-07:43:32] [V] [TRT] Tactic: 5898239 Time: 0.019088
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6029311 Time: 0.04016
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6225919 Time: 0.022144
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6291455 Time: 0.020608
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6422527 Time: 0.0256
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6750207 Time: 0.02176
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6815743 Time: 0.02816
[05/21/2021-07:43:32] [V] [TRT] Tactic: 6946815 Time: 0.024232
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7012351 Time: 0.021632
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7077887 Time: 0.022792
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7143423 Time: 0.032432
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7208959 Time: 0.028672
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7340031 Time: 0.02048
[05/21/2021-07:43:32] [V] [TRT] Tactic: 7405567 Time: 0.020524
[05/21/2021-07:43:33] [V] [TRT] Tactic: 7536639 Time: 0.038956
[05/21/2021-07:43:33] [V] [TRT] Tactic: 7602175 Time: 0.023336
[05/21/2021-07:43:33] [V] [TRT] Tactic: 7733247 Time: 0.023712
[05/21/2021-07:43:33] [V] [TRT] Tactic: 7798783 Time: 0.022772
[05/21/2021-07:43:33] [V] [TRT] Tactic: 8191999 Time: 0.028308
[05/21/2021-07:43:33] [V] [TRT] Tactic: 8257535 Time: 0.022108
[05/21/2021-07:43:33] [V] [TRT] Tactic: 8323071 Time: 0.024008
[05/21/2021-07:43:33] [V] [TRT] Tactic: 8650751 Time: 0.025088
[05/21/2021-07:43:33] [V] [TRT] Tactic: 8716287 Time: 0.023448
[05/21/2021-07:43:33] [V] [TRT] Tactic: 9109503 Time: 0.021632
[05/21/2021-07:43:33] [V] [TRT] Tactic: 9568255 Time: 0.021004
[05/21/2021-07:43:33] [V] [TRT] Tactic: 9895935 Time: 0.023588
[05/21/2021-07:43:33] [V] [TRT] Tactic: 10223615 Time: 0.044324
[05/21/2021-07:43:33] [V] [TRT] Tactic: 10354687 Time: 0.026368
[05/21/2021-07:43:33] [V] [TRT] Tactic: 10551295 Time: 0.029964
[05/21/2021-07:43:33] [V] [TRT] Tactic: 10747903 Time: 0.022928
[05/21/2021-07:43:33] [V] [TRT] Tactic: 10944511 Time: 0.029056
[05/21/2021-07:43:33] [V] [TRT] Fastest Tactic: 4653055 Time: 0.018688
[05/21/2021-07:43:33] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:33] [V] [TRT] Tactic: 0 Time: 0.019704
[05/21/2021-07:43:33] [V] [TRT] Tactic: 1 Time: 0.020248
[05/21/2021-07:43:33] [V] [TRT] Tactic: 2 Time: 0.080152
[05/21/2021-07:43:33] [V] [TRT] Tactic: 4 Time: 0.8879
[05/21/2021-07:43:33] [V] [TRT] Tactic: 5 Time: 0.208432
[05/21/2021-07:43:33] [V] [TRT] Tactic: 56 Time: 0.02142
[05/21/2021-07:43:33] [V] [TRT] Tactic: 57 Time: 0.020608
[05/21/2021-07:43:33] [V] [TRT] Tactic: 58 Time: 0.082096
[05/21/2021-07:43:33] [V] [TRT] Tactic: 60 Time: 0.887408
[05/21/2021-07:43:33] [V] [TRT] Tactic: 61 Time: 0.208088
[05/21/2021-07:43:33] [V] [TRT] Tactic: 112 Time: 0.020428
[05/21/2021-07:43:33] [V] [TRT] Tactic: 113 Time: 0.020108
[05/21/2021-07:43:33] [V] [TRT] Tactic: 114 Time: 0.08
[05/21/2021-07:43:33] [V] [TRT] Tactic: 116 Time: 0.886532
[05/21/2021-07:43:33] [V] [TRT] Tactic: 117 Time: 0.20992
[05/21/2021-07:43:33] [V] [TRT] Fastest Tactic: 0 Time: 0.019704
[05/21/2021-07:43:33] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:33] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:33] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:33] [V] [TRT] Tactic: 4549827808004681195 Time: 0.029664
[05/21/2021-07:43:33] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:33] [V] [TRT] Tactic: 5779835512569528575 Time: 0.03624
[05/21/2021-07:43:33] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:43:33] [V] [TRT] Tactic: 9151672657204310840 Time: 0.039552
[05/21/2021-07:43:33] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:43:33] [V] [TRT] Tactic: -7491730084094677098 Time: 0.033888
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:43:34] [V] [TRT] Tactic: -6622064180404051845 Time: 0.034808
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:34] [V] [TRT] Tactic: -6313876406580483184 Time: 0.040832
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:43:34] [V] [TRT] Tactic: -6273689210331812572 Time: 0.035468
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:43:34] [V] [TRT] Tactic: -4337126844824617177 Time: 0.028056
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:34] [V] [TRT] Tactic: -1123676555321336786 Time: 0.035968
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:34] [V] [TRT] Tactic: -701551393537224327 Time: 0.030464
[05/21/2021-07:43:34] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.028056
[05/21/2021-07:43:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4653055
[05/21/2021-07:43:34] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:34] [V] [TRT] Tactic: 1663866669559596164 Time: 0.035732
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:34] [V] [TRT] Tactic: 2860655430572478466 Time: 0.023168
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4474630279712975759 Time: 0.016304
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01536
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4696204239951173149 Time: 0.022528
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:34] [V] [TRT] Tactic: 5778138195697110003 Time: 0.037248
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:34] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0338
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:34] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02112
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:34] [V] [TRT] Tactic: -4035591156787122265 Time: 0.015872
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:34] [V] [TRT] Tactic: -2809379259463049391 Time: 0.036124
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:34] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033672
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:34] [V] [TRT] Tactic: -504296718212024303 Time: 0.033068
[05/21/2021-07:43:34] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.01536
[05/21/2021-07:43:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:34] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:43:34] [V] [TRT] Tactic: 1373022415249282411 Time: 0.02444
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:34] [V] [TRT] Tactic: 1663866669559596164 Time: 0.03536
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:34] [V] [TRT] Tactic: 2860655430572478466 Time: 0.023296
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4474630279712975759 Time: 0.016384
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4479823862704990365 Time: 0.016148
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:34] [V] [TRT] Tactic: 4696204239951173149 Time: 0.023168
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:34] [V] [TRT] Tactic: 5778138195697110003 Time: 0.036324
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:34] [V] [TRT] Tactic: 8918020581761223752 Time: 0.033324
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:43:34] [V] [TRT] Tactic: -7067026478815706014 Time: 0.027048
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:34] [V] [TRT] Tactic: -5905193483742532701 Time: 0.02112
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:34] [V] [TRT] Tactic: -4035591156787122265 Time: 0.01536
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:34] [V] [TRT] Tactic: -2809379259463049391 Time: 0.035456
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:34] [V] [TRT] Tactic: -1985235291706575900 Time: 0.03288
[05/21/2021-07:43:34] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:34] [V] [TRT] Tactic: -504296718212024303 Time: 0.033408
[05/21/2021-07:43:34] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.01536
[05/21/2021-07:43:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:34] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:43:34] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:34] [V] [TRT] Tactic: 0 Time: 0.02538
[05/21/2021-07:43:34] [V] [TRT] Tactic: 1 Time: 0.02304
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2 Time: 0.084352
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4 Time: 0.881052
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5 Time: 0.20528
[05/21/2021-07:43:35] [V] [TRT] Tactic: 56 Time: 0.0224
[05/21/2021-07:43:35] [V] [TRT] Tactic: 58 Time: 0.08284
[05/21/2021-07:43:35] [V] [TRT] Tactic: 60 Time: 0.879456
[05/21/2021-07:43:35] [V] [TRT] Tactic: 61 Time: 0.208124
[05/21/2021-07:43:35] [V] [TRT] Fastest Tactic: 56 Time: 0.0224
[05/21/2021-07:43:35] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:35] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:43:35] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:43:35] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:35] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:43:35] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:43:35] [V] [TRT] Tactic: 589823 Time: 0.03478
[05/21/2021-07:43:35] [V] [TRT] Tactic: 655359 Time: 0.0256
[05/21/2021-07:43:35] [V] [TRT] Tactic: 786431 Time: 0.014812
[05/21/2021-07:43:35] [V] [TRT] Tactic: 851967 Time: 0.015744
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1179647 Time: 0.012764
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1310719 Time: 0.021028
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1376255 Time: 0.02654
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1441791 Time: 0.01236
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1507327 Time: 0.017408
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1638399 Time: 0.014336
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1835007 Time: 0.01536
[05/21/2021-07:43:35] [V] [TRT] Tactic: 1900543 Time: 0.028544
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2097151 Time: 0.013824
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2162687 Time: 0.027264
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2293759 Time: 0.024996
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2359295 Time: 0.017676
[05/21/2021-07:43:35] [V] [TRT] Tactic: 2686975 Time: 0.0256
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3080191 Time: 0.01592
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3342335 Time: 0.017692
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3407871 Time: 0.016752
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3538943 Time: 0.013452
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3670015 Time: 0.044672
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3932159 Time: 0.022632
[05/21/2021-07:43:35] [V] [TRT] Tactic: 3997695 Time: 0.013272
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4063231 Time: 0.012976
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4194303 Time: 0.014336
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4259839 Time: 0.01408
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4325375 Time: 0.013532
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4521983 Time: 0.024752
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4587519 Time: 0.013184
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4653055 Time: 0.012288
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4915199 Time: 0.013312
[05/21/2021-07:43:35] [V] [TRT] Tactic: 4980735 Time: 0.016424
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5177343 Time: 0.015256
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5242879 Time: 0.016432
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5373951 Time: 0.013604
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5439487 Time: 0.015372
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5570559 Time: 0.01792
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5636095 Time: 0.0128
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5701631 Time: 0.023948
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5767167 Time: 0.01984
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5832703 Time: 0.017184
[05/21/2021-07:43:35] [V] [TRT] Tactic: 5898239 Time: 0.013236
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6029311 Time: 0.023072
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6225919 Time: 0.01336
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6291455 Time: 0.012936
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6422527 Time: 0.01548
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6750207 Time: 0.014228
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6815743 Time: 0.017408
[05/21/2021-07:43:35] [V] [TRT] Tactic: 6946815 Time: 0.01536
[05/21/2021-07:43:35] [V] [TRT] Tactic: 7012351 Time: 0.01344
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7077887 Time: 0.013952
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7143423 Time: 0.019584
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7208959 Time: 0.017584
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7340031 Time: 0.013312
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7405567 Time: 0.012672
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7536639 Time: 0.022696
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7602175 Time: 0.014672
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7733247 Time: 0.01408
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7798783 Time: 0.014748
[05/21/2021-07:43:36] [V] [TRT] Tactic: 8191999 Time: 0.01664
[05/21/2021-07:43:36] [V] [TRT] Tactic: 8257535 Time: 0.013952
[05/21/2021-07:43:36] [V] [TRT] Tactic: 8323071 Time: 0.01536
[05/21/2021-07:43:36] [V] [TRT] Tactic: 8650751 Time: 0.015872
[05/21/2021-07:43:36] [V] [TRT] Tactic: 8716287 Time: 0.014376
[05/21/2021-07:43:36] [V] [TRT] Tactic: 9109503 Time: 0.013696
[05/21/2021-07:43:36] [V] [TRT] Tactic: 9568255 Time: 0.013312
[05/21/2021-07:43:36] [V] [TRT] Tactic: 9895935 Time: 0.014336
[05/21/2021-07:43:36] [V] [TRT] Tactic: 10223615 Time: 0.025216
[05/21/2021-07:43:36] [V] [TRT] Tactic: 10354687 Time: 0.014336
[05/21/2021-07:43:36] [V] [TRT] Tactic: 10551295 Time: 0.02192
[05/21/2021-07:43:36] [V] [TRT] Tactic: 10747903 Time: 0.013872
[05/21/2021-07:43:36] [V] [TRT] Tactic: 10944511 Time: 0.016684
[05/21/2021-07:43:36] [V] [TRT] Fastest Tactic: 4653055 Time: 0.012288
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:36] [V] [TRT] Tactic: 2195670545862694453 Time: 0.019116
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:36] [V] [TRT] Tactic: 3891805945559659536 Time: 0.024592
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:36] [V] [TRT] Tactic: 4418200634486186714 Time: 0.01704
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:36] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018432
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:36] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017664
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:36] [V] [TRT] Tactic: 7392644644614664811 Time: 0.017416
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:36] [V] [TRT] Tactic: -4884039206922900293 Time: 0.023552
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:36] [V] [TRT] Tactic: -4374269919094467161 Time: 0.01728
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:36] [V] [TRT] Tactic: -1546027692247304867 Time: 0.024308
[05/21/2021-07:43:36] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.01704
[05/21/2021-07:43:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4653055
[05/21/2021-07:43:36] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(200704,196,14,1) ***************
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:36] [V] [TRT] Tactic: 0 Time: 0.029824
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1 Time: 0.026624
[05/21/2021-07:43:36] [V] [TRT] Tactic: 2 Time: 0.067712
[05/21/2021-07:43:36] [V] [TRT] Tactic: 56 Time: 0.029664
[05/21/2021-07:43:36] [V] [TRT] Tactic: 58 Time: 0.067712
[05/21/2021-07:43:36] [V] [TRT] Fastest Tactic: 1 Time: 0.026624
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:36] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:36] [V] [TRT] Tactic: 254850674756030979 Time: 0.01664
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1156328698016730421 Time: 0.011904
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1362727228442059924 Time: 0.01174
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0096
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009188
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1838082074606840426 Time: 0.009208
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:36] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008184
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:36] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009436
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:36] [V] [TRT] Tactic: 2541579301352125276 Time: 0.011568
[05/21/2021-07:43:36] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:37] [V] [TRT] Tactic: 2559328254295148085 Time: 0.016896
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:37] [V] [TRT] Tactic: 2657157263811141609 Time: 0.008192
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:37] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009108
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009776
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009344
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01146
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3513075359009385578 Time: 0.016384
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3704534001553878387 Time: 0.011264
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:43:37] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007984
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4278315135102886928 Time: 0.008748
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008624
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4480294673430783793 Time: 0.008704
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4491683531415781597 Time: 0.016428
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4528997467275241200 Time: 0.011264
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4571819373777460444 Time: 0.016384
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016516
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4802447371470387646 Time: 0.011776
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:43:37] [V] [TRT] Tactic: 4993757826442493905 Time: 0.007728
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:37] [V] [TRT] Tactic: 5059676457552313631 Time: 0.015988
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:37] [V] [TRT] Tactic: 5205510332404400949 Time: 0.01056
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:37] [V] [TRT] Tactic: 5346855796032465921 Time: 0.01284
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:37] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012052
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:37] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00832
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:37] [V] [TRT] Tactic: 6377497238381488891 Time: 0.011496
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:37] [V] [TRT] Tactic: 6468794451065529747 Time: 0.009592
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:43:37] [V] [TRT] Tactic: 6697277555581639516 Time: 0.008208
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:37] [V] [TRT] Tactic: 6859477213531075460 Time: 0.007708
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:37] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013056
[05/21/2021-07:43:37] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:38] [V] [TRT] Tactic: 7609923741161019135 Time: 0.00942
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:38] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008596
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:38] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01216
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:38] [V] [TRT] Tactic: 8764780417487154889 Time: 0.011776
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:43:38] [V] [TRT] Tactic: 8823554289762712606 Time: 0.008704
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:38] [V] [TRT] Tactic: 8839784824303350101 Time: 0.011904
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:43:38] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0081
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:38] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0128
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:38] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00766
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:38] [V] [TRT] Tactic: -8280443484414412687 Time: 0.015536
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:38] [V] [TRT] Tactic: -8205952393017864204 Time: 0.017316
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:38] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009528
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:38] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008364
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:38] [V] [TRT] Tactic: -7099920365135295801 Time: 0.008316
[05/21/2021-07:43:38] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:39] [V] [TRT] Tactic: -7089118800560870395 Time: 0.007508
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:43:39] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01152
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:39] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0085
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:39] [V] [TRT] Tactic: -6063766379489217211 Time: 0.009264
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:39] [V] [TRT] Tactic: -5530886555766748586 Time: 0.011136
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:39] [V] [TRT] Tactic: -5409588854490562130 Time: 0.007192
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:39] [V] [TRT] Tactic: -5161596964442251102 Time: 0.008576
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:39] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008192
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00832
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4796511246675321840 Time: 0.009856
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008064
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00856
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4293222705763522367 Time: 0.007492
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4152066959007262150 Time: 0.016768
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:39] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009012
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3987638434926559037 Time: 0.009472
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3905653247016903130 Time: 0.012288
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3903342530518878192 Time: 0.011256
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3864869056275745423 Time: 0.011264
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3601464762214218301 Time: 0.007204
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:39] [V] [TRT] Tactic: -3058330359340425555 Time: 0.009632
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:39] [V] [TRT] Tactic: -2878731503146438856 Time: 0.011932
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:39] [V] [TRT] Tactic: -2602982885923184927 Time: 0.011264
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:39] [V] [TRT] Tactic: -2353603993968373338 Time: 0.011648
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:39] [V] [TRT] Tactic: -2032577876140256150 Time: 0.00936
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:39] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00824
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01216
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1828674067637788567 Time: 0.009224
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1640527254204634147 Time: 0.008696
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1562548049711204899 Time: 0.011536
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1242202084391243207 Time: 0.008892
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008064
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:39] [V] [TRT] Tactic: -1038291877007553549 Time: 0.008704
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:39] [V] [TRT] Tactic: -406984317033388136 Time: 0.011392
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:39] [V] [TRT] Tactic: -331499326992534460 Time: 0.008328
[05/21/2021-07:43:39] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:43:39] [V] [TRT] Tactic: -206523504474952360 Time: 0.012036
[05/21/2021-07:43:39] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.007192
[05/21/2021-07:43:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[05/21/2021-07:43:39] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:43:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CublasConvolution)
[05/21/2021-07:43:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: stage3_unit1_conv3 (CaskConvolution)
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:43:40] [V] [TRT] Tactic: 162720039126739803 Time: 0.00672
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:43:40] [V] [TRT] Tactic: 382577144988222004 Time: 0.008228
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:40] [V] [TRT] Tactic: 2334614616543277495 Time: 0.009268
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:40] [V] [TRT] Tactic: 4126996489741716394 Time: 0.007212
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:43:40] [V] [TRT] Tactic: 6466136707377588846 Time: 0.007072
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:43:40] [V] [TRT] Tactic: 6958123061428231366 Time: 0.006976
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:40] [V] [TRT] Tactic: 8940522081427638481 Time: 0.007168
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:43:40] [V] [TRT] Tactic: -7023377647582255231 Time: 0.006656
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:40] [V] [TRT] Tactic: -6148657501329441429 Time: 0.007172
[05/21/2021-07:43:40] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:40] [V] [TRT] Tactic: -3396930063803107917 Time: 0.007296
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: -7023377647582255231 Time: 0.006656
[05/21/2021-07:43:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7023377647582255231
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.010456
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006524
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006524
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.048128
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.005356
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005356
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007432
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.0073
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.004296
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004296
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007148
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006832
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006832
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.009352
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007968
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.007276
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.007276
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.006704
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.0105
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00658
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00658
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006912
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007684
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.007184
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.007184
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.006728
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.005656
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005656
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.006664
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00574
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00574
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.048384
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.005204
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.005204
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006784
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006784
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.006944
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006944
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.010112
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.00434
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00434
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:40] [V] [TRT] Tactic: 1002 Time: 0.008196
[05/21/2021-07:43:40] [V] [TRT] Tactic: 0 Time: 0.0041
[05/21/2021-07:43:40] [V] [TRT] Fastest Tactic: 0 Time: 0.0041
[05/21/2021-07:43:40] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.008364
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00706
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00706
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.009628
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00578
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00578
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005752
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005752
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.012824
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.004064
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004064
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.008204
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00412
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00412
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006564
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00594
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00594
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.010812
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.00758
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006724
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.008876
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.006728
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006728
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006808
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005604
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005604
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.005672
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005672
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.010444
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.006296
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006296
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.006528
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006528
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1002 Time: 0.006248
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.00538
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00538
[05/21/2021-07:43:41] [V] [TRT] *************** Autotuning format combination: Float(401408,784,28,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudaDepthwiseConvolution)
[05/21/2021-07:43:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (FusedConvActConvolution)
[05/21/2021-07:43:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:41] [V] [TRT] Tactic: 0 Time: 0.036184
[05/21/2021-07:43:41] [V] [TRT] Tactic: 1 Time: 0.03584
[05/21/2021-07:43:41] [V] [TRT] Tactic: 2 Time: 0.096572
[05/21/2021-07:43:41] [V] [TRT] Tactic: 56 Time: 0.038464
[05/21/2021-07:43:41] [V] [TRT] Tactic: 57 Time: 0.037796
[05/21/2021-07:43:41] [V] [TRT] Tactic: 58 Time: 0.140908
[05/21/2021-07:43:41] [V] [TRT] Tactic: 112 Time: 0.042624
[05/21/2021-07:43:41] [V] [TRT] Tactic: 113 Time: 0.037772
[05/21/2021-07:43:41] [V] [TRT] Tactic: 114 Time: 0.140672
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: 1 Time: 0.03584
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:41] [V] [TRT] Tactic: 4549827808004681195 Time: 0.055564
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:41] [V] [TRT] Tactic: 5779835512569528575 Time: 0.078604
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:43:41] [V] [TRT] Tactic: 9151672657204310840 Time: 0.072448
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:43:41] [V] [TRT] Tactic: -7491730084094677098 Time: 0.086056
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:41] [V] [TRT] Tactic: -6313876406580483184 Time: 0.090272
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:43:41] [V] [TRT] Tactic: -6273689210331812572 Time: 0.077872
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:43:41] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0469
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:41] [V] [TRT] Tactic: -1123676555321336786 Time: 0.069632
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:41] [V] [TRT] Tactic: -701551393537224327 Time: 0.052224
[05/21/2021-07:43:41] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.0469
[05/21/2021-07:43:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:43:41] [V] [TRT] *************** Autotuning format combination: Float(401408,1,14336,512), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:41] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:41] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:42] [V] [TRT] Tactic: 1663866669559596164 Time: 0.070192
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:42] [V] [TRT] Tactic: 2860655430572478466 Time: 0.042368
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4474630279712975759 Time: 0.027776
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4479823862704990365 Time: 0.027548
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4696204239951173149 Time: 0.041472
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:42] [V] [TRT] Tactic: 5778138195697110003 Time: 0.070048
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:42] [V] [TRT] Tactic: 8918020581761223752 Time: 0.062848
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:42] [V] [TRT] Tactic: -5905193483742532701 Time: 0.037888
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:42] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023936
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:42] [V] [TRT] Tactic: -2809379259463049391 Time: 0.065844
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:42] [V] [TRT] Tactic: -1985235291706575900 Time: 0.05952
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:42] [V] [TRT] Tactic: -504296718212024303 Time: 0.060416
[05/21/2021-07:43:42] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023936
[05/21/2021-07:43:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:42] [V] [TRT] *************** Autotuning format combination: Float(100352,1:4,3584,128), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:43:42] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:42] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:42] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:43:42] [V] [TRT] Tactic: 1373022415249282411 Time: 0.046932
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:42] [V] [TRT] Tactic: 1663866669559596164 Time: 0.069268
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:42] [V] [TRT] Tactic: 2860655430572478466 Time: 0.042248
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4474630279712975759 Time: 0.027904
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4479823862704990365 Time: 0.027264
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:42] [V] [TRT] Tactic: 4696204239951173149 Time: 0.041268
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:42] [V] [TRT] Tactic: 5778138195697110003 Time: 0.069888
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:43:42] [V] [TRT] Tactic: 7342025736444949634 Time: 0.04672
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:42] [V] [TRT] Tactic: 8918020581761223752 Time: 0.062752
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:42] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034784
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:43:42] [V] [TRT] Tactic: -5457304872213719461 Time: 0.044244
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:42] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023876
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:42] [V] [TRT] Tactic: -2809379259463049391 Time: 0.069904
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:42] [V] [TRT] Tactic: -1985235291706575900 Time: 0.063488
[05/21/2021-07:43:42] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:42] [V] [TRT] Tactic: -504296718212024303 Time: 0.064044
[05/21/2021-07:43:42] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023876
[05/21/2021-07:43:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:42] [V] [TRT] *************** Autotuning format combination: Half(401408,784,28,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:43:42] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:42] [V] [TRT] Tactic: 0 Time: 0.039556
[05/21/2021-07:43:42] [V] [TRT] Tactic: 1 Time: 0.039356
[05/21/2021-07:43:42] [V] [TRT] Tactic: 2 Time: 0.102156
[05/21/2021-07:43:42] [V] [TRT] Tactic: 56 Time: 0.038912
[05/21/2021-07:43:42] [V] [TRT] Tactic: 58 Time: 0.105984
[05/21/2021-07:43:42] [V] [TRT] Fastest Tactic: 56 Time: 0.038912
[05/21/2021-07:43:42] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:43:43] [V] [TRT] *************** Autotuning format combination: Half(200704,784:2,28,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (FusedConvActConvolution)
[05/21/2021-07:43:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:43] [V] [TRT] Tactic: 2195670545862694453 Time: 0.030828
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:43] [V] [TRT] Tactic: 3891805945559659536 Time: 0.04288
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:43] [V] [TRT] Tactic: 4418200634486186714 Time: 0.027132
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:43] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029824
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:43] [V] [TRT] Tactic: 6057304366605292508 Time: 0.028416
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:43] [V] [TRT] Tactic: 7392644644614664811 Time: 0.027948
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:43] [V] [TRT] Tactic: -4884039206922900293 Time: 0.042804
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:43] [V] [TRT] Tactic: -4374269919094467161 Time: 0.029232
[05/21/2021-07:43:43] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:43] [V] [TRT] Tactic: -1546027692247304867 Time: 0.04276
[05/21/2021-07:43:43] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.027132
[05/21/2021-07:43:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:43:43] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:43] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] *************** Autotuning format combination: Half(50176,1:8,1792,64), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudaDepthwiseConvolution)
[05/21/2021-07:43:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:43] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:43] [V] [TRT] Tactic: 0 Time: 0.055424
[05/21/2021-07:43:43] [V] [TRT] Tactic: 1 Time: 0.053208
[05/21/2021-07:43:43] [V] [TRT] Tactic: 2 Time: 0.090704
[05/21/2021-07:43:43] [V] [TRT] Tactic: 56 Time: 0.057412
[05/21/2021-07:43:44] [V] [TRT] Tactic: 58 Time: 0.090124
[05/21/2021-07:43:44] [V] [TRT] Fastest Tactic: 1 Time: 0.053208
[05/21/2021-07:43:44] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:44] [V] [TRT] Tactic: 254850674756030979 Time: 0.026624
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1011057357468998345 Time: 0.017616
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01792
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1362727228442059924 Time: 0.018304
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1576319725282257846 Time: 0.012432
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1832046141070096030 Time: 0.012176
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011392
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:44] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009728
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2238656696610018305 Time: 0.013312
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2428167804343994714 Time: 0.011676
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01704
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2559328254295148085 Time: 0.025728
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0107
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:44] [V] [TRT] Tactic: 2968605903460894194 Time: 0.012288
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:44] [V] [TRT] Tactic: 3071479995783211391 Time: 0.01344
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:44] [V] [TRT] Tactic: 3359475309458902373 Time: 0.010268
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:44] [V] [TRT] Tactic: 3362537467505018070 Time: 0.016392
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:44] [V] [TRT] Tactic: 3513075359009385578 Time: 0.025984
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:44] [V] [TRT] Tactic: 3704534001553878387 Time: 0.017412
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:44] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011904
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:44] [V] [TRT] Tactic: 4480294673430783793 Time: 0.01122
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:44] [V] [TRT] Tactic: 4571819373777460444 Time: 0.02658
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:44] [V] [TRT] Tactic: 4802447371470387646 Time: 0.017712
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:44] [V] [TRT] Tactic: 5059676457552313631 Time: 0.025972
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:44] [V] [TRT] Tactic: 5205510332404400949 Time: 0.016812
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:44] [V] [TRT] Tactic: 5346855796032465921 Time: 0.017684
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:43:44] [V] [TRT] Tactic: 5368829646735632944 Time: 0.008192
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:44] [V] [TRT] Tactic: 5398999388616959893 Time: 0.017188
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01042
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6154447660803990543 Time: 0.012544
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6325769668000961702 Time: 0.017748
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6350273239113254096 Time: 0.01394
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6377497238381488891 Time: 0.016912
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6468794451065529747 Time: 0.012544
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:44] [V] [TRT] Tactic: 6859477213531075460 Time: 0.009908
[05/21/2021-07:43:44] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:43:45] [V] [TRT] Tactic: 6979044990896381511 Time: 0.0256
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:45] [V] [TRT] Tactic: 7216571380637776659 Time: 0.019328
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:45] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011264
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:43:45] [V] [TRT] Tactic: 8072087735545283117 Time: 0.024596
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:45] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01024
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:45] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01286
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:45] [V] [TRT] Tactic: 8764780417487154889 Time: 0.01728
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:45] [V] [TRT] Tactic: 8839784824303350101 Time: 0.01856
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:45] [V] [TRT] Tactic: -9009272790678027912 Time: 0.018692
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8985224497679592364 Time: 0.010476
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8759929675070720385 Time: 0.016908
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01024
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8280443484414412687 Time: 0.026112
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8205952393017864204 Time: 0.024056
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:45] [V] [TRT] Tactic: -8131857373260504832 Time: 0.010868
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:45] [V] [TRT] Tactic: -7410012245391920273 Time: 0.010112
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:45] [V] [TRT] Tactic: -7099920365135295801 Time: 0.011136
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:45] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00988
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:43:45] [V] [TRT] Tactic: -6799856376604253964 Time: 0.0261
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:43:45] [V] [TRT] Tactic: -6525498856028268801 Time: 0.01664
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:45] [V] [TRT] Tactic: -6356316196810535311 Time: 0.011136
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:43:45] [V] [TRT] Tactic: -6324345858751792783 Time: 0.01206
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:45] [V] [TRT] Tactic: -6063766379489217211 Time: 0.012416
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5777580938094193096 Time: 0.011136
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5657273398217409378 Time: 0.024552
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5530886555766748586 Time: 0.016752
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5409588854490562130 Time: 0.009452
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5161596964442251102 Time: 0.012292
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:45] [V] [TRT] Tactic: -5127240325355316006 Time: 0.011264
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4950923835688973492 Time: 0.009472
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4825567853927730435 Time: 0.011756
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4796511246675321840 Time: 0.012544
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4548822885169694805 Time: 0.01024
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011752
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4293222705763522367 Time: 0.009508
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4152066959007262150 Time: 0.026624
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:45] [V] [TRT] Tactic: -4021926646879732549 Time: 0.011244
[05/21/2021-07:43:45] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3987638434926559037 Time: 0.012276
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3905653247016903130 Time: 0.017424
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3903974568488493144 Time: 0.011248
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3903342530518878192 Time: 0.017192
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3864869056275745423 Time: 0.01782
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3601464762214218301 Time: 0.009568
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3338665856053412950 Time: 0.016892
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3058330359340425555 Time: 0.012032
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016928
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2662892962457732243 Time: 0.011264
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2602982885923184927 Time: 0.016356
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2530740716768816092 Time: 0.014424
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2353603993968373338 Time: 0.017408
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2332828394978346992 Time: 0.017716
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2161909437867201546 Time: 0.01408
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2032577876140256150 Time: 0.012416
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:46] [V] [TRT] Tactic: -2003055242756584050 Time: 0.011264
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1985778916402815946 Time: 0.018432
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1640527254204634147 Time: 0.012208
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1562548049711204899 Time: 0.016512
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1242202084391243207 Time: 0.011568
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1099247066487349374 Time: 0.010112
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:46] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011508
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:43:46] [V] [TRT] Tactic: -910286698936744682 Time: 0.008576
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:43:46] [V] [TRT] Tactic: -606726295133751039 Time: 0.0102
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:46] [V] [TRT] Tactic: -406984317033388136 Time: 0.016712
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:46] [V] [TRT] Tactic: -331499326992534460 Time: 0.01152
[05/21/2021-07:43:46] [V] [TRT] Fastest Tactic: 5368829646735632944 Time: 0.008192
[05/21/2021-07:43:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5368829646735632944
[05/21/2021-07:43:46] [V] [TRT] *************** Autotuning format combination: Half(25088,1:16,896,32), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:43:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CudnnConvolution)
[05/21/2021-07:43:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:46] [V] [TRT] --------------- Timing Runner: stage3_unit1_sc + _plus7 (CaskConvolution)
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:43:46] [V] [TRT] Tactic: 1301213148470244380 Time: 0.01026
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:43:46] [V] [TRT] Tactic: 2140378925901736289 Time: 0.009856
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:46] [V] [TRT] Tactic: 2334614616543277495 Time: 0.012416
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:46] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008508
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:43:46] [V] [TRT] Tactic: 7019285522757193163 Time: 0.012824
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:43:46] [V] [TRT] Tactic: 7616509406849244401 Time: 0.010384
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:46] [V] [TRT] Tactic: 8940522081427638481 Time: 0.009472
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:43:46] [V] [TRT] Tactic: -6575010824547653277 Time: 0.009216
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:46] [V] [TRT] Tactic: -6148657501329441429 Time: 0.008576
[05/21/2021-07:43:46] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:46] [V] [TRT] Tactic: -3396930063803107917 Time: 0.009216
[05/21/2021-07:43:46] [V] [TRT] Fastest Tactic: 4126996489741716394 Time: 0.008508
[05/21/2021-07:43:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4126996489741716394
[05/21/2021-07:43:46] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:46] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:43:46] [V] [TRT] Tactic: 0 Time: 0.006696
[05/21/2021-07:43:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006696
[05/21/2021-07:43:46] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:46] [V] [TRT] Tactic: 1002 Time: 0.01068
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006948
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006948
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.048536
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005968
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005968
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.004424
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004424
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007064
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.004392
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004392
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007052
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.011356
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.009472
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005456
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005456
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.008212
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006944
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006944
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006756
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006756
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005104
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005104
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(200704,1,14336,1024) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006408
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.011284
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.009516
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005144
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005144
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.008112
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00704
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007568
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.007176
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.007176
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.006756
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005648
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005648
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Float(50176,1:4,3584,256) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.006832
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005528
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005528
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.048128
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006188
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006188
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.0064
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0064
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.010112
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.008832
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.00414
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.00414
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(200704,196,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.008564
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.0064
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0064
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.009536
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007448
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.005692
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.005692
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.01304
[05/21/2021-07:43:47] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:43:47] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:43:47] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:47] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.004116
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004116
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196:2,14,1) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.00744
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.005504
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005504
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.0089
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.00414
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00414
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.005236
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005236
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.011136
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.0043
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0043
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.007692
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,1:8,1792,128) -> Half(12544,1:16,896,64) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.006488
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,196,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.008888
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.006708
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006708
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(200704,1,14336,1024) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.006596
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.005392
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005392
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Float(50176,1:4,3584,256) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.0068
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.00568
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00568
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(200704,196,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.010676
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.006272
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006272
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(100352,196:2,14,1) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.006656
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.006656
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:16,896,64) -> Half(25088,1:8,1792,128) (Reformat)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1002 Time: 0.006648
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.004448
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004448
[05/21/2021-07:43:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.00412
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00412
[05/21/2021-07:43:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.004896
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004896
[05/21/2021-07:43:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 0 Time: 0.00566
[05/21/2021-07:43:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00566
[05/21/2021-07:43:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_bn1 + stage3_unit2_relu1 (Scale)
[05/21/2021-07:43:48] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:43:48] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:43:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:48] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:43:48] [V] [TRT] Tactic: 589823 Time: 0.213904
[05/21/2021-07:43:48] [V] [TRT] Tactic: 655359 Time: 0.137472
[05/21/2021-07:43:48] [V] [TRT] Tactic: 786431 Time: 0.048288
[05/21/2021-07:43:48] [V] [TRT] Tactic: 851967 Time: 0.042116
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1179647 Time: 0.026972
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1310719 Time: 0.092416
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1376255 Time: 0.144052
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1441791 Time: 0.031448
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1507327 Time: 0.076032
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1638399 Time: 0.032652
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1835007 Time: 0.054144
[05/21/2021-07:43:48] [V] [TRT] Tactic: 1900543 Time: 0.145672
[05/21/2021-07:43:48] [V] [TRT] Tactic: 2097151 Time: 0.019864
[05/21/2021-07:43:48] [V] [TRT] Tactic: 2162687 Time: 0.14736
[05/21/2021-07:43:48] [V] [TRT] Tactic: 2293759 Time: 0.130048
[05/21/2021-07:43:48] [V] [TRT] Tactic: 2359295 Time: 0.077828
[05/21/2021-07:43:48] [V] [TRT] Tactic: 2686975 Time: 0.134224
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3080191 Time: 0.06656
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3342335 Time: 0.075776
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3407871 Time: 0.068748
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3538943 Time: 0.039936
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3670015 Time: 0.269208
[05/21/2021-07:43:48] [V] [TRT] Tactic: 3932159 Time: 0.11648
[05/21/2021-07:43:49] [V] [TRT] Tactic: 3997695 Time: 0.028416
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4063231 Time: 0.042572
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4194303 Time: 0.053128
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4259839 Time: 0.021288
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4325375 Time: 0.038856
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4521983 Time: 0.132992
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4587519 Time: 0.029184
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4653055 Time: 0.029216
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4915199 Time: 0.029724
[05/21/2021-07:43:49] [V] [TRT] Tactic: 4980735 Time: 0.0704
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5177343 Time: 0.02688
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5242879 Time: 0.063784
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5373951 Time: 0.029312
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5439487 Time: 0.048152
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5570559 Time: 0.074384
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5636095 Time: 0.04288
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5701631 Time: 0.128424
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5767167 Time: 0.073856
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5832703 Time: 0.071008
[05/21/2021-07:43:49] [V] [TRT] Tactic: 5898239 Time: 0.029956
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6029311 Time: 0.125064
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6225919 Time: 0.038184
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6291455 Time: 0.026752
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6422527 Time: 0.064928
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6750207 Time: 0.028288
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6815743 Time: 0.068736
[05/21/2021-07:43:49] [V] [TRT] Tactic: 6946815 Time: 0.04544
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7012351 Time: 0.019456
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7077887 Time: 0.039552
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7143423 Time: 0.070688
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7208959 Time: 0.07106
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7340031 Time: 0.030632
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7405567 Time: 0.035636
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7536639 Time: 0.114224
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7602175 Time: 0.045596
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7733247 Time: 0.043776
[05/21/2021-07:43:49] [V] [TRT] Tactic: 7798783 Time: 0.048128
[05/21/2021-07:43:49] [V] [TRT] Tactic: 8191999 Time: 0.041788
[05/21/2021-07:43:49] [V] [TRT] Tactic: 8257535 Time: 0.030144
[05/21/2021-07:43:49] [V] [TRT] Tactic: 8323071 Time: 0.046208
[05/21/2021-07:43:49] [V] [TRT] Tactic: 8650751 Time: 0.046464
[05/21/2021-07:43:49] [V] [TRT] Tactic: 8716287 Time: 0.040064
[05/21/2021-07:43:49] [V] [TRT] Tactic: 9109503 Time: 0.020224
[05/21/2021-07:43:49] [V] [TRT] Tactic: 9568255 Time: 0.029644
[05/21/2021-07:43:49] [V] [TRT] Tactic: 9895935 Time: 0.052224
[05/21/2021-07:43:49] [V] [TRT] Tactic: 10223615 Time: 0.134216
[05/21/2021-07:43:49] [V] [TRT] Tactic: 10354687 Time: 0.030796
[05/21/2021-07:43:49] [V] [TRT] Tactic: 10551295 Time: 0.074944
[05/21/2021-07:43:49] [V] [TRT] Tactic: 10747903 Time: 0.041032
[05/21/2021-07:43:49] [V] [TRT] Tactic: 10944511 Time: 0.068864
[05/21/2021-07:43:49] [V] [TRT] Fastest Tactic: 7012351 Time: 0.019456
[05/21/2021-07:43:49] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:49] [V] [TRT] Tactic: 0 Time: 0.071424
[05/21/2021-07:43:49] [V] [TRT] Tactic: 1 Time: 0.043904
[05/21/2021-07:43:49] [V] [TRT] Tactic: 2 Time: 0.133156
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4 Time: 0.888348
[05/21/2021-07:43:50] [V] [TRT] Tactic: 5 Time: 0.21004
[05/21/2021-07:43:50] [V] [TRT] Tactic: 56 Time: 0.053248
[05/21/2021-07:43:50] [V] [TRT] Tactic: 57 Time: 0.044288
[05/21/2021-07:43:50] [V] [TRT] Tactic: 58 Time: 0.123008
[05/21/2021-07:43:50] [V] [TRT] Tactic: 60 Time: 0.888152
[05/21/2021-07:43:50] [V] [TRT] Tactic: 61 Time: 0.210564
[05/21/2021-07:43:50] [V] [TRT] Tactic: 112 Time: 0.057984
[05/21/2021-07:43:50] [V] [TRT] Tactic: 113 Time: 0.044288
[05/21/2021-07:43:50] [V] [TRT] Tactic: 114 Time: 0.123776
[05/21/2021-07:43:50] [V] [TRT] Tactic: 116 Time: 0.88858
[05/21/2021-07:43:50] [V] [TRT] Tactic: 117 Time: 0.209684
[05/21/2021-07:43:50] [V] [TRT] Fastest Tactic: 1 Time: 0.043904
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4549827808004681195 Time: 0.090752
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:50] [V] [TRT] Tactic: 5779835512569528575 Time: 0.116004
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:43:50] [V] [TRT] Tactic: 9151672657204310840 Time: 0.097576
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:43:50] [V] [TRT] Tactic: -7491730084094677098 Time: 0.117112
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:43:50] [V] [TRT] Tactic: -6622064180404051845 Time: 0.107264
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:50] [V] [TRT] Tactic: -6313876406580483184 Time: 0.119316
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:43:50] [V] [TRT] Tactic: -6273689210331812572 Time: 0.114944
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:43:50] [V] [TRT] Tactic: -4337126844824617177 Time: 0.084776
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:50] [V] [TRT] Tactic: -1123676555321336786 Time: 0.115456
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:50] [V] [TRT] Tactic: -701551393537224327 Time: 0.09564
[05/21/2021-07:43:50] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.084776
[05/21/2021-07:43:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[05/21/2021-07:43:50] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.12176
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:50] [V] [TRT] Tactic: 2860655430572478466 Time: 0.069888
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4474630279712975759 Time: 0.040348
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4479823862704990365 Time: 0.039424
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4696204239951173149 Time: 0.07018
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:50] [V] [TRT] Tactic: 5778138195697110003 Time: 0.123928
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:50] [V] [TRT] Tactic: 8918020581761223752 Time: 0.111244
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:50] [V] [TRT] Tactic: -5905193483742532701 Time: 0.061776
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:50] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0391
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:50] [V] [TRT] Tactic: -2809379259463049391 Time: 0.121392
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:50] [V] [TRT] Tactic: -1985235291706575900 Time: 0.111304
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:50] [V] [TRT] Tactic: -504296718212024303 Time: 0.112896
[05/21/2021-07:43:50] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0391
[05/21/2021-07:43:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:50] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:50] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:50] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:43:50] [V] [TRT] Tactic: 1373022415249282411 Time: 0.077312
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:43:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.12564
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:50] [V] [TRT] Tactic: 2860655430572478466 Time: 0.06992
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:50] [V] [TRT] Tactic: 4474630279712975759 Time: 0.04036
[05/21/2021-07:43:50] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4479823862704990365 Time: 0.040064
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4696204239951173149 Time: 0.069632
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:51] [V] [TRT] Tactic: 5778138195697110003 Time: 0.123008
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:51] [V] [TRT] Tactic: 8918020581761223752 Time: 0.111284
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:43:51] [V] [TRT] Tactic: -7067026478815706014 Time: 0.080512
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:43:51] [V] [TRT] Tactic: -5905193483742532701 Time: 0.061696
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:43:51] [V] [TRT] Tactic: -4035591156787122265 Time: 0.038668
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:51] [V] [TRT] Tactic: -2809379259463049391 Time: 0.121844
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:43:51] [V] [TRT] Tactic: -1985235291706575900 Time: 0.11072
[05/21/2021-07:43:51] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:51] [V] [TRT] Tactic: -504296718212024303 Time: 0.115072
[05/21/2021-07:43:51] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.038668
[05/21/2021-07:43:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:43:51] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:43:51] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:51] [V] [TRT] Tactic: 0 Time: 0.055936
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1 Time: 0.053632
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2 Time: 0.106496
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4 Time: 0.880632
[05/21/2021-07:43:51] [V] [TRT] Tactic: 5 Time: 0.208072
[05/21/2021-07:43:51] [V] [TRT] Tactic: 56 Time: 0.056448
[05/21/2021-07:43:51] [V] [TRT] Tactic: 58 Time: 0.107904
[05/21/2021-07:43:51] [V] [TRT] Tactic: 60 Time: 0.880532
[05/21/2021-07:43:51] [V] [TRT] Tactic: 61 Time: 0.208408
[05/21/2021-07:43:51] [V] [TRT] Fastest Tactic: 1 Time: 0.053632
[05/21/2021-07:43:51] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:51] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:43:51] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:43:51] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:51] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:43:51] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:43:51] [V] [TRT] Tactic: 589823 Time: 0.112256
[05/21/2021-07:43:51] [V] [TRT] Tactic: 655359 Time: 0.080936
[05/21/2021-07:43:51] [V] [TRT] Tactic: 786431 Time: 0.029696
[05/21/2021-07:43:51] [V] [TRT] Tactic: 851967 Time: 0.0256
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1179647 Time: 0.016792
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1310719 Time: 0.05634
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1376255 Time: 0.083872
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1441791 Time: 0.019368
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1507327 Time: 0.046032
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1638399 Time: 0.019328
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1835007 Time: 0.028672
[05/21/2021-07:43:51] [V] [TRT] Tactic: 1900543 Time: 0.0864
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2097151 Time: 0.013604
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2162687 Time: 0.086312
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2293759 Time: 0.074416
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2359295 Time: 0.04662
[05/21/2021-07:43:51] [V] [TRT] Tactic: 2686975 Time: 0.076288
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3080191 Time: 0.04032
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3342335 Time: 0.046084
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3407871 Time: 0.039808
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3538943 Time: 0.023088
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3670015 Time: 0.154648
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3932159 Time: 0.064384
[05/21/2021-07:43:51] [V] [TRT] Tactic: 3997695 Time: 0.018576
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4063231 Time: 0.024824
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4194303 Time: 0.02816
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4259839 Time: 0.013772
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4325375 Time: 0.022092
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4521983 Time: 0.07616
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4587519 Time: 0.017536
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4653055 Time: 0.018996
[05/21/2021-07:43:51] [V] [TRT] Tactic: 4915199 Time: 0.018048
[05/21/2021-07:43:52] [V] [TRT] Tactic: 4980735 Time: 0.03858
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5177343 Time: 0.017408
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5242879 Time: 0.03708
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5373951 Time: 0.017408
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5439487 Time: 0.027264
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5570559 Time: 0.044544
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5636095 Time: 0.024772
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5701631 Time: 0.07168
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5767167 Time: 0.041636
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5832703 Time: 0.041108
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5898239 Time: 0.01984
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6029311 Time: 0.068684
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6225919 Time: 0.021504
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6291455 Time: 0.017024
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6422527 Time: 0.036096
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6750207 Time: 0.020224
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6815743 Time: 0.040836
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6946815 Time: 0.029296
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7012351 Time: 0.01344
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7077887 Time: 0.023448
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7143423 Time: 0.039852
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7208959 Time: 0.041728
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7340031 Time: 0.019992
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7405567 Time: 0.022528
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7536639 Time: 0.061668
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7602175 Time: 0.027904
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7733247 Time: 0.026624
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7798783 Time: 0.029868
[05/21/2021-07:43:52] [V] [TRT] Tactic: 8191999 Time: 0.024104
[05/21/2021-07:43:52] [V] [TRT] Tactic: 8257535 Time: 0.018648
[05/21/2021-07:43:52] [V] [TRT] Tactic: 8323071 Time: 0.026624
[05/21/2021-07:43:52] [V] [TRT] Tactic: 8650751 Time: 0.028448
[05/21/2021-07:43:52] [V] [TRT] Tactic: 8716287 Time: 0.023552
[05/21/2021-07:43:52] [V] [TRT] Tactic: 9109503 Time: 0.013592
[05/21/2021-07:43:52] [V] [TRT] Tactic: 9568255 Time: 0.017792
[05/21/2021-07:43:52] [V] [TRT] Tactic: 9895935 Time: 0.027824
[05/21/2021-07:43:52] [V] [TRT] Tactic: 10223615 Time: 0.076048
[05/21/2021-07:43:52] [V] [TRT] Tactic: 10354687 Time: 0.016384
[05/21/2021-07:43:52] [V] [TRT] Tactic: 10551295 Time: 0.043084
[05/21/2021-07:43:52] [V] [TRT] Tactic: 10747903 Time: 0.0256
[05/21/2021-07:43:52] [V] [TRT] Tactic: 10944511 Time: 0.038656
[05/21/2021-07:43:52] [V] [TRT] Fastest Tactic: 7012351 Time: 0.01344
[05/21/2021-07:43:52] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:52] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:52] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:52] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:52] [V] [TRT] Tactic: 2195670545862694453 Time: 0.05376
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:52] [V] [TRT] Tactic: 3891805945559659536 Time: 0.076084
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:43:52] [V] [TRT] Tactic: 4418200634486186714 Time: 0.045612
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:52] [V] [TRT] Tactic: 5548126322150286555 Time: 0.051072
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:52] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048128
[05/21/2021-07:43:52] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:43:52] [V] [TRT] Tactic: 7392644644614664811 Time: 0.04706
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:43:53] [V] [TRT] Tactic: -4884039206922900293 Time: 0.075776
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:53] [V] [TRT] Tactic: -4374269919094467161 Time: 0.048768
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:53] [V] [TRT] Tactic: -1546027692247304867 Time: 0.077056
[05/21/2021-07:43:53] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.045612
[05/21/2021-07:43:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[05/21/2021-07:43:53] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:53] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:53] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:43:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:53] [V] [TRT] Tactic: 0 Time: 0.07168
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1 Time: 0.062976
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2 Time: 0.096256
[05/21/2021-07:43:53] [V] [TRT] Tactic: 56 Time: 0.072576
[05/21/2021-07:43:53] [V] [TRT] Tactic: 58 Time: 0.094336
[05/21/2021-07:43:53] [V] [TRT] Fastest Tactic: 1 Time: 0.062976
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:53] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:43:53] [V] [TRT] Tactic: 254850674756030979 Time: 0.04254
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1156328698016730421 Time: 0.026752
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1362727228442059924 Time: 0.027904
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1576319725282257846 Time: 0.01586
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1832046141070096030 Time: 0.015384
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1838082074606840426 Time: 0.01536
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:43:53] [V] [TRT] Tactic: 1899296423087490472 Time: 0.010624
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2238656696610018305 Time: 0.015368
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2541579301352125276 Time: 0.02496
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2559328254295148085 Time: 0.042028
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011264
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:43:53] [V] [TRT] Tactic: 2968605903460894194 Time: 0.01554
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3071479995783211391 Time: 0.008704
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3359475309458902373 Time: 0.01536
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3362537467505018070 Time: 0.024064
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3513075359009385578 Time: 0.043132
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3704534001553878387 Time: 0.024576
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:43:53] [V] [TRT] Tactic: 3899310434460415852 Time: 0.009716
[05/21/2021-07:43:53] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4278315135102886928 Time: 0.015744
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4370476717970497892 Time: 0.01472
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4480294673430783793 Time: 0.014592
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4491683531415781597 Time: 0.041984
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4528997467275241200 Time: 0.024196
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4571819373777460444 Time: 0.043
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4595173549602041350 Time: 0.042404
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0264
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:43:54] [V] [TRT] Tactic: 4993757826442493905 Time: 0.014592
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:43:54] [V] [TRT] Tactic: 5059676457552313631 Time: 0.042008
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:43:54] [V] [TRT] Tactic: 5205510332404400949 Time: 0.024308
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:43:54] [V] [TRT] Tactic: 5346855796032465921 Time: 0.02354
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:43:54] [V] [TRT] Tactic: 5398999388616959893 Time: 0.025624
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:43:54] [V] [TRT] Tactic: 6034364043891107501 Time: 0.015232
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:43:54] [V] [TRT] Tactic: 6377497238381488891 Time: 0.024656
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:43:54] [V] [TRT] Tactic: 6468794451065529747 Time: 0.015872
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:43:54] [V] [TRT] Tactic: 6697277555581639516 Time: 0.01438
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:43:54] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0106
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:43:54] [V] [TRT] Tactic: 7216571380637776659 Time: 0.02944
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:43:54] [V] [TRT] Tactic: 7609923741161019135 Time: 0.015104
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:43:54] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01128
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:43:54] [V] [TRT] Tactic: 8170606396342855895 Time: 0.015656
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:43:54] [V] [TRT] Tactic: 8764780417487154889 Time: 0.025012
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:43:54] [V] [TRT] Tactic: 8823554289762712606 Time: 0.015444
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:43:54] [V] [TRT] Tactic: 8839784824303350101 Time: 0.027776
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:43:54] [V] [TRT] Tactic: -9203179519031456182 Time: 0.011392
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:43:54] [V] [TRT] Tactic: -9009272790678027912 Time: 0.028232
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:43:54] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011196
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:43:54] [V] [TRT] Tactic: -8280443484414412687 Time: 0.041984
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:43:54] [V] [TRT] Tactic: -8205952393017864204 Time: 0.041728
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:43:54] [V] [TRT] Tactic: -8131857373260504832 Time: 0.014356
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:43:54] [V] [TRT] Tactic: -7410012245391920273 Time: 0.011264
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:43:54] [V] [TRT] Tactic: -7099920365135295801 Time: 0.013676
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:43:54] [V] [TRT] Tactic: -7089118800560870395 Time: 0.010496
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:43:54] [V] [TRT] Tactic: -6768327495007644783 Time: 0.02432
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:43:54] [V] [TRT] Tactic: -6356316196810535311 Time: 0.011648
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:43:54] [V] [TRT] Tactic: -6063766379489217211 Time: 0.015648
[05/21/2021-07:43:54] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:43:55] [V] [TRT] Tactic: -5530886555766748586 Time: 0.024704
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:43:55] [V] [TRT] Tactic: -5409588854490562130 Time: 0.011188
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:43:55] [V] [TRT] Tactic: -5161596964442251102 Time: 0.015616
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:43:55] [V] [TRT] Tactic: -5127240325355316006 Time: 0.014668
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4950923835688973492 Time: 0.010316
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4796511246675321840 Time: 0.015744
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4548822885169694805 Time: 0.010524
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4379519430184503304 Time: 0.01458
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4293222705763522367 Time: 0.010368
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4152066959007262150 Time: 0.043428
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:43:55] [V] [TRT] Tactic: -4021926646879732549 Time: 0.015104
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3987638434926559037 Time: 0.015744
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3905653247016903130 Time: 0.026272
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3903342530518878192 Time: 0.025204
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3864869056275745423 Time: 0.026004
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3601464762214218301 Time: 0.010496
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:43:55] [V] [TRT] Tactic: -3058330359340425555 Time: 0.01536
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:43:55] [V] [TRT] Tactic: -2878731503146438856 Time: 0.023392
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:43:55] [V] [TRT] Tactic: -2602982885923184927 Time: 0.024788
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:43:55] [V] [TRT] Tactic: -2353603993968373338 Time: 0.026624
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:43:55] [V] [TRT] Tactic: -2032577876140256150 Time: 0.01606
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:43:55] [V] [TRT] Tactic: -2003055242756584050 Time: 0.014336
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1985778916402815946 Time: 0.026752
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1828674067637788567 Time: 0.008796
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1640527254204634147 Time: 0.01536
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1562548049711204899 Time: 0.023504
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1242202084391243207 Time: 0.014852
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1099247066487349374 Time: 0.010792
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:43:55] [V] [TRT] Tactic: -1038291877007553549 Time: 0.015872
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:43:55] [V] [TRT] Tactic: -406984317033388136 Time: 0.025088
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:43:55] [V] [TRT] Tactic: -331499326992534460 Time: 0.014872
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:43:55] [V] [TRT] Tactic: -206523504474952360 Time: 0.024764
[05/21/2021-07:43:55] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.008704
[05/21/2021-07:43:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391
[05/21/2021-07:43:55] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:43:55] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:43:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:55] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CublasConvolution)
[05/21/2021-07:43:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:55] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv1 + stage3_unit2_relu2 (CaskConvolution)
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:43:55] [V] [TRT] Tactic: 162720039126739803 Time: 0.010752
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:43:55] [V] [TRT] Tactic: 382577144988222004 Time: 0.014896
[05/21/2021-07:43:55] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2334614616543277495 Time: 0.01432
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:43:56] [V] [TRT] Tactic: 4126996489741716394 Time: 0.009692
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:43:56] [V] [TRT] Tactic: 6466136707377588846 Time: 0.007332
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:43:56] [V] [TRT] Tactic: 6958123061428231366 Time: 0.010368
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:43:56] [V] [TRT] Tactic: 8940522081427638481 Time: 0.0113
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:43:56] [V] [TRT] Tactic: -7023377647582255231 Time: 0.009728
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:43:56] [V] [TRT] Tactic: -6148657501329441429 Time: 0.010752
[05/21/2021-07:43:56] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:43:56] [V] [TRT] Tactic: -3396930063803107917 Time: 0.007976
[05/21/2021-07:43:56] [V] [TRT] Fastest Tactic: 6466136707377588846 Time: 0.007332
[05/21/2021-07:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6466136707377588846
[05/21/2021-07:43:56] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:56] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:56] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:56] [V] [TRT] Tactic: 524287 Time: 0.107628
[05/21/2021-07:43:56] [V] [TRT] Tactic: 720895 Time: 0.085032
[05/21/2021-07:43:56] [V] [TRT] Tactic: 983039 Time: 0.044584
[05/21/2021-07:43:56] [V] [TRT] Tactic: 1048575 Time: 0.070656
[05/21/2021-07:43:56] [V] [TRT] Tactic: 1703935 Time: 0.038656
[05/21/2021-07:43:56] [V] [TRT] Tactic: 1769471 Time: 0.041088
[05/21/2021-07:43:56] [V] [TRT] Tactic: 1966079 Time: 0.176128
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2031615 Time: 0.140288
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2228223 Time: 0.076288
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2424831 Time: 0.0329
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2621439 Time: 0.031588
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2752511 Time: 0.094036
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2818047 Time: 0.089344
[05/21/2021-07:43:56] [V] [TRT] Tactic: 2883583 Time: 0.206464
[05/21/2021-07:43:56] [V] [TRT] Tactic: 3014655 Time: 0.045056
[05/21/2021-07:43:56] [V] [TRT] Tactic: 3145727 Time: 0.050344
[05/21/2021-07:43:56] [V] [TRT] Tactic: 3473407 Time: 0.11158
[05/21/2021-07:43:56] [V] [TRT] Tactic: 3604479 Time: 0.046592
[05/21/2021-07:43:56] [V] [TRT] Tactic: 3735551 Time: 0.08896
[05/21/2021-07:43:56] [V] [TRT] Tactic: 4390911 Time: 0.188032
[05/21/2021-07:43:56] [V] [TRT] Tactic: 5046271 Time: 0.063744
[05/21/2021-07:43:56] [V] [TRT] Tactic: 5963775 Time: 0.151728
[05/21/2021-07:43:56] [V] [TRT] Tactic: 6160383 Time: 0.0896
[05/21/2021-07:43:56] [V] [TRT] Tactic: 6488063 Time: 0.0768
[05/21/2021-07:43:56] [V] [TRT] Tactic: 6881279 Time: 0.126208
[05/21/2021-07:43:56] [V] [TRT] Tactic: 7274495 Time: 0.033792
[05/21/2021-07:43:56] [V] [TRT] Tactic: 7864319 Time: 0.033184
[05/21/2021-07:43:56] [V] [TRT] Tactic: 7995391 Time: 0.093864
[05/21/2021-07:43:56] [V] [TRT] Tactic: 8585215 Time: 0.122816
[05/21/2021-07:43:56] [V] [TRT] Tactic: 8847359 Time: 0.03456
[05/21/2021-07:43:56] [V] [TRT] Tactic: 8978431 Time: 0.16256
[05/21/2021-07:43:56] [V] [TRT] Tactic: 9043967 Time: 0.04416
[05/21/2021-07:43:56] [V] [TRT] Tactic: 9175039 Time: 0.04544
[05/21/2021-07:43:56] [V] [TRT] Tactic: 9502719 Time: 0.183204
[05/21/2021-07:43:56] [V] [TRT] Tactic: 9830399 Time: 0.087808
[05/21/2021-07:43:56] [V] [TRT] Tactic: 9961471 Time: 0.03626
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10027007 Time: 0.06648
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10092543 Time: 0.179308
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10289151 Time: 0.176
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10485759 Time: 0.035712
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10682367 Time: 0.03072
[05/21/2021-07:43:57] [V] [TRT] Tactic: 10813439 Time: 0.048768
[05/21/2021-07:43:57] [V] [TRT] Fastest Tactic: 10682367 Time: 0.03072
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:57] [V] [TRT] Tactic: 0 Time: 0.142208
[05/21/2021-07:43:57] [V] [TRT] Tactic: 1 Time: 0.068992
[05/21/2021-07:43:57] [V] [TRT] Tactic: 2 Time: 0.154624
[05/21/2021-07:43:57] [V] [TRT] Tactic: 4 Time: 0.249216
[05/21/2021-07:43:57] [V] [TRT] Tactic: 5 Time: 0.747172
[05/21/2021-07:43:57] [V] [TRT] Tactic: 6 Time: 0.055296
[05/21/2021-07:43:57] [V] [TRT] Tactic: 56 Time: 0.120192
[05/21/2021-07:43:57] [V] [TRT] Tactic: 57 Time: 0.069248
[05/21/2021-07:43:57] [V] [TRT] Tactic: 58 Time: 0.154624
[05/21/2021-07:43:57] [V] [TRT] Tactic: 60 Time: 0.248912
[05/21/2021-07:43:57] [V] [TRT] Tactic: 61 Time: 0.746952
[05/21/2021-07:43:57] [V] [TRT] Tactic: 62 Time: 0.054912
[05/21/2021-07:43:57] [V] [TRT] Tactic: 112 Time: 0.122656
[05/21/2021-07:43:57] [V] [TRT] Tactic: 113 Time: 0.123648
[05/21/2021-07:43:57] [V] [TRT] Tactic: 114 Time: 0.154496
[05/21/2021-07:43:57] [V] [TRT] Tactic: 116 Time: 0.2488
[05/21/2021-07:43:57] [V] [TRT] Tactic: 117 Time: 0.74692
[05/21/2021-07:43:57] [V] [TRT] Tactic: 118 Time: 0.054784
[05/21/2021-07:43:57] [V] [TRT] Fastest Tactic: 118 Time: 0.054784
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:43:57] [V] [TRT] Tactic: 4549827808004681195 Time: 0.195712
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:43:57] [V] [TRT] Tactic: 5779835512569528575 Time: 0.250772
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:43:57] [V] [TRT] Tactic: 6053873026024413720 Time: 0.26418
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:43:57] [V] [TRT] Tactic: 6767548733843469815 Time: 0.20608
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:43:57] [V] [TRT] Tactic: -6313876406580483184 Time: 0.280192
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:43:57] [V] [TRT] Tactic: -1123676555321336786 Time: 0.26304
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:43:57] [V] [TRT] Tactic: -701551393537224327 Time: 0.227968
[05/21/2021-07:43:57] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.195712
[05/21/2021-07:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[05/21/2021-07:43:57] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:57] [V] [TRT] Tactic: 2860655430572478466 Time: 0.147872
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:57] [V] [TRT] Tactic: 4474630279712975759 Time: 0.082448
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:57] [V] [TRT] Tactic: 4479823862704990365 Time: 0.080808
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:57] [V] [TRT] Tactic: 4696204239951173149 Time: 0.148736
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:57] [V] [TRT] Tactic: 5778138195697110003 Time: 0.259968
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:57] [V] [TRT] Tactic: 7155825427510256858 Time: 0.248868
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:57] [V] [TRT] Tactic: 8918020581761223752 Time: 0.244016
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:57] [V] [TRT] Tactic: -4756382386362004279 Time: 0.145664
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:57] [V] [TRT] Tactic: -3855385237722507464 Time: 0.258844
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:57] [V] [TRT] Tactic: -2809379259463049391 Time: 0.25664
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:57] [V] [TRT] Tactic: -504296718212024303 Time: 0.24448
[05/21/2021-07:43:57] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.080808
[05/21/2021-07:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:57] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:57] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:57] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:43:57] [V] [TRT] Tactic: 2860655430572478466 Time: 0.147968
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:43:58] [V] [TRT] Tactic: 4474630279712975759 Time: 0.08448
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:43:58] [V] [TRT] Tactic: 4479823862704990365 Time: 0.080788
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:43:58] [V] [TRT] Tactic: 4696204239951173149 Time: 0.148788
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:43:58] [V] [TRT] Tactic: 5778138195697110003 Time: 0.259288
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:43:58] [V] [TRT] Tactic: 7155825427510256858 Time: 0.249088
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:43:58] [V] [TRT] Tactic: 7342025736444949634 Time: 0.168848
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:43:58] [V] [TRT] Tactic: 8918020581761223752 Time: 0.244488
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:43:58] [V] [TRT] Tactic: -7377458734869418330 Time: 0.169936
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:43:58] [V] [TRT] Tactic: -5457304872213719461 Time: 0.17152
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:43:58] [V] [TRT] Tactic: -4756382386362004279 Time: 0.146176
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:43:58] [V] [TRT] Tactic: -3855385237722507464 Time: 0.259484
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:43:58] [V] [TRT] Tactic: -2809379259463049391 Time: 0.255104
[05/21/2021-07:43:58] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:43:58] [V] [TRT] Tactic: -504296718212024303 Time: 0.244224
[05/21/2021-07:43:58] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.080788
[05/21/2021-07:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:43:58] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:43:58] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:58] [V] [TRT] Tactic: 0 Time: 0.127616
[05/21/2021-07:43:58] [V] [TRT] Tactic: 1 Time: 0.125952
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2 Time: 0.10944
[05/21/2021-07:43:58] [V] [TRT] Tactic: 4 Time: 0.246744
[05/21/2021-07:43:58] [V] [TRT] Tactic: 5 Time: 0.734932
[05/21/2021-07:43:58] [V] [TRT] Tactic: 6 Time: 0.072192
[05/21/2021-07:43:58] [V] [TRT] Tactic: 56 Time: 0.127872
[05/21/2021-07:43:58] [V] [TRT] Tactic: 58 Time: 0.104136
[05/21/2021-07:43:58] [V] [TRT] Tactic: 60 Time: 0.245716
[05/21/2021-07:43:58] [V] [TRT] Tactic: 61 Time: 0.735024
[05/21/2021-07:43:58] [V] [TRT] Tactic: 62 Time: 0.07104
[05/21/2021-07:43:58] [V] [TRT] Fastest Tactic: 62 Time: 0.07104
[05/21/2021-07:43:58] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62
[05/21/2021-07:43:58] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:43:58] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:43:58] [V] [TRT] Tactic: 524287 Time: 0.067972
[05/21/2021-07:43:58] [V] [TRT] Tactic: 720895 Time: 0.057344
[05/21/2021-07:43:58] [V] [TRT] Tactic: 983039 Time: 0.029984
[05/21/2021-07:43:58] [V] [TRT] Tactic: 1048575 Time: 0.04514
[05/21/2021-07:43:58] [V] [TRT] Tactic: 1703935 Time: 0.025516
[05/21/2021-07:43:58] [V] [TRT] Tactic: 1769471 Time: 0.029696
[05/21/2021-07:43:58] [V] [TRT] Tactic: 1966079 Time: 0.110908
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2031615 Time: 0.094016
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2228223 Time: 0.046836
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2424831 Time: 0.022364
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2621439 Time: 0.021164
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2752511 Time: 0.062856
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2818047 Time: 0.057364
[05/21/2021-07:43:58] [V] [TRT] Tactic: 2883583 Time: 0.13312
[05/21/2021-07:43:58] [V] [TRT] Tactic: 3014655 Time: 0.029732
[05/21/2021-07:43:58] [V] [TRT] Tactic: 3145727 Time: 0.0338
[05/21/2021-07:43:59] [V] [TRT] Tactic: 3473407 Time: 0.068276
[05/21/2021-07:43:59] [V] [TRT] Tactic: 3604479 Time: 0.029844
[05/21/2021-07:43:59] [V] [TRT] Tactic: 3735551 Time: 0.05326
[05/21/2021-07:43:59] [V] [TRT] Tactic: 4390911 Time: 0.122852
[05/21/2021-07:43:59] [V] [TRT] Tactic: 5046271 Time: 0.036768
[05/21/2021-07:43:59] [V] [TRT] Tactic: 5963775 Time: 0.103168
[05/21/2021-07:43:59] [V] [TRT] Tactic: 6160383 Time: 0.060824
[05/21/2021-07:43:59] [V] [TRT] Tactic: 6488063 Time: 0.054676
[05/21/2021-07:43:59] [V] [TRT] Tactic: 6881279 Time: 0.08438
[05/21/2021-07:43:59] [V] [TRT] Tactic: 7274495 Time: 0.022272
[05/21/2021-07:43:59] [V] [TRT] Tactic: 7864319 Time: 0.021264
[05/21/2021-07:43:59] [V] [TRT] Tactic: 7995391 Time: 0.05952
[05/21/2021-07:43:59] [V] [TRT] Tactic: 8585215 Time: 0.076172
[05/21/2021-07:43:59] [V] [TRT] Tactic: 8847359 Time: 0.022956
[05/21/2021-07:43:59] [V] [TRT] Tactic: 8978431 Time: 0.101904
[05/21/2021-07:43:59] [V] [TRT] Tactic: 9043967 Time: 0.028332
[05/21/2021-07:43:59] [V] [TRT] Tactic: 9175039 Time: 0.030472
[05/21/2021-07:43:59] [V] [TRT] Tactic: 9502719 Time: 0.120324
[05/21/2021-07:43:59] [V] [TRT] Tactic: 9830399 Time: 0.05632
[05/21/2021-07:43:59] [V] [TRT] Tactic: 9961471 Time: 0.024064
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10027007 Time: 0.041356
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10092543 Time: 0.121488
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10289151 Time: 0.111104
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10485759 Time: 0.022912
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10682367 Time: 0.020748
[05/21/2021-07:43:59] [V] [TRT] Tactic: 10813439 Time: 0.032292
[05/21/2021-07:43:59] [V] [TRT] Fastest Tactic: 10682367 Time: 0.020748
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:43:59] [V] [TRT] Tactic: 2195670545862694453 Time: 0.126864
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:43:59] [V] [TRT] Tactic: 3419182076704469245 Time: 0.121644
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:43:59] [V] [TRT] Tactic: 3891805945559659536 Time: 0.167976
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:43:59] [V] [TRT] Tactic: 5548126322150286555 Time: 0.116736
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:43:59] [V] [TRT] Tactic: 6057304366605292508 Time: 0.100352
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:43:59] [V] [TRT] Tactic: -7928611605886347652 Time: 0.170624
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:43:59] [V] [TRT] Tactic: -5172391392092686714 Time: 0.137768
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:43:59] [V] [TRT] Tactic: -4374269919094467161 Time: 0.101664
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953
[05/21/2021-07:43:59] [V] [TRT] Tactic: -4083394051665370953 Time: 0.026688
[05/21/2021-07:43:59] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:43:59] [V] [TRT] Tactic: -1546027692247304867 Time: 0.16512
[05/21/2021-07:43:59] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.026688
[05/21/2021-07:43:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[05/21/2021-07:43:59] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:59] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:43:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:59] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:43:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:43:59] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:43:59] [V] [TRT] Tactic: 0 Time: 1.17981
[05/21/2021-07:43:59] [V] [TRT] Tactic: 1 Time: 0.304212
[05/21/2021-07:43:59] [V] [TRT] Tactic: 2 Time: 0.11728
[05/21/2021-07:44:00] [V] [TRT] Tactic: 6 Time: 0.070144
[05/21/2021-07:44:00] [V] [TRT] Tactic: 56 Time: 1.1785
[05/21/2021-07:44:00] [V] [TRT] Tactic: 58 Time: 0.127232
[05/21/2021-07:44:00] [V] [TRT] Tactic: 62 Time: 0.069888
[05/21/2021-07:44:00] [V] [TRT] Fastest Tactic: 62 Time: 0.069888
[05/21/2021-07:44:00] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:00] [V] [TRT] Tactic: 254850674756030979 Time: 0.0864
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:44:00] [V] [TRT] Tactic: 328038211831149625 Time: 0.085228
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:44:00] [V] [TRT] Tactic: 411553864378931917 Time: 0.02626
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1011057357468998345 Time: 0.04988
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1156328698016730421 Time: 0.052656
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1723736032573714698 Time: 0.024576
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1832046141070096030 Time: 0.025852
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1838082074606840426 Time: 0.025856
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:00] [V] [TRT] Tactic: 1899296423087490472 Time: 0.016688
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2428167804343994714 Time: 0.027264
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2541579301352125276 Time: 0.046384
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2657157263811141609 Time: 0.01664
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2819719497590964443 Time: 0.027136
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2968605903460894194 Time: 0.026752
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:44:00] [V] [TRT] Tactic: 2986078304285316765 Time: 0.047672
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:00] [V] [TRT] Tactic: 3362537467505018070 Time: 0.045256
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:00] [V] [TRT] Tactic: 3513075359009385578 Time: 0.087168
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:44:00] [V] [TRT] Tactic: 3573559043797674382 Time: 0.026616
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:44:00] [V] [TRT] Tactic: 3591970081995419777 Time: 0.016544
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:00] [V] [TRT] Tactic: 3704534001553878387 Time: 0.048788
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:00] [V] [TRT] Tactic: 4278315135102886928 Time: 0.026368
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:44:00] [V] [TRT] Tactic: 4503233883285355107 Time: 0.019664
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:00] [V] [TRT] Tactic: 4802447371470387646 Time: 0.047772
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5059676457552313631 Time: 0.085828
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5368829646735632944 Time: 0.017232
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5398999388616959893 Time: 0.04848
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5746691132547383910 Time: 0.027008
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5770170567977052602 Time: 0.04992
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:44:00] [V] [TRT] Tactic: 5953552212833506549 Time: 0.044672
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:00] [V] [TRT] Tactic: 6034364043891107501 Time: 0.025512
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:44:00] [V] [TRT] Tactic: 6074229447555668232 Time: 0.017828
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:44:00] [V] [TRT] Tactic: 6154447660803990543 Time: 0.026652
[05/21/2021-07:44:00] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6325769668000961702 Time: 0.046772
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6350273239113254096 Time: 0.013332
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6377497238381488891 Time: 0.04608
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6446388116965632819 Time: 0.026932
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.02688
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6642277870194067185 Time: 0.089088
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.016424
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6972489290272968208 Time: 0.045184
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:44:01] [V] [TRT] Tactic: 6979044990896381511 Time: 0.085768
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.058372
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:01] [V] [TRT] Tactic: 7609923741161019135 Time: 0.026496
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:44:01] [V] [TRT] Tactic: 7705739241028240201 Time: 0.017664
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:44:01] [V] [TRT] Tactic: 8072087735545283117 Time: 0.086788
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:01] [V] [TRT] Tactic: 8101703987960976805 Time: 0.018108
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:01] [V] [TRT] Tactic: 8170606396342855895 Time: 0.026752
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:01] [V] [TRT] Tactic: 8839784824303350101 Time: 0.051456
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:44:01] [V] [TRT] Tactic: -9217371357561775773 Time: 0.017536
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:01] [V] [TRT] Tactic: -9009272790678027912 Time: 0.051496
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:44:01] [V] [TRT] Tactic: -8985224497679592364 Time: 0.019456
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:44:01] [V] [TRT] Tactic: -8949544755481315679 Time: 0.027484
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:44:01] [V] [TRT] Tactic: -8759929675070720385 Time: 0.047404
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:01] [V] [TRT] Tactic: -8604374562669615024 Time: 0.017536
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6902925267326201166 Time: 0.013708
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6840588038605932325 Time: 0.026624
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6799856376604253964 Time: 0.085516
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6625722781282978136 Time: 0.026776
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6525498856028268801 Time: 0.047112
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6356316196810535311 Time: 0.018432
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6324345858751792783 Time: 0.02564
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6262400699544994312 Time: 0.084016
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6257787336162086472 Time: 0.05224
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:01] [V] [TRT] Tactic: -6063766379489217211 Time: 0.026368
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:44:01] [V] [TRT] Tactic: -5777580938094193096 Time: 0.027648
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:44:01] [V] [TRT] Tactic: -5657273398217409378 Time: 0.087296
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:01] [V] [TRT] Tactic: -5530886555766748586 Time: 0.045748
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:44:01] [V] [TRT] Tactic: -5422685219138380548 Time: 0.025728
[05/21/2021-07:44:01] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:02] [V] [TRT] Tactic: -5161596964442251102 Time: 0.026512
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:02] [V] [TRT] Tactic: -5127240325355316006 Time: 0.025564
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4825567853927730435 Time: 0.025148
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4796511246675321840 Time: 0.026356
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4706569565442112734 Time: 0.018688
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4566599693570369588 Time: 0.046944
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4409144516525410768 Time: 0.046336
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4379519430184503304 Time: 0.026112
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4152066959007262150 Time: 0.087424
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:02] [V] [TRT] Tactic: -4021926646879732549 Time: 0.026112
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3987638434926559037 Time: 0.02688
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3905653247016903130 Time: 0.050048
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3903974568488493144 Time: 0.028672
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3895429239811098010 Time: 0.02562
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3864869056275745423 Time: 0.04706
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3601464762214218301 Time: 0.016548
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3412636942650049698 Time: 0.05018
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3338665856053412950 Time: 0.046592
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:02] [V] [TRT] Tactic: -3058330359340425555 Time: 0.026624
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2816084650627734155 Time: 0.053296
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2662892962457732243 Time: 0.02624
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2559894581585337900 Time: 0.086316
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2530740716768816092 Time: 0.045324
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2332828394978346992 Time: 0.046872
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2241736083352441442 Time: 0.058496
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:44:02] [V] [TRT] Tactic: -2161909437867201546 Time: 0.015352
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:02] [V] [TRT] Tactic: -1985778916402815946 Time: 0.049144
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:44:02] [V] [TRT] Tactic: -1500496213132463076 Time: 0.026992
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:02] [V] [TRT] Tactic: -1099247066487349374 Time: 0.016916
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:44:02] [V] [TRT] Tactic: -910286698936744682 Time: 0.016256
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:44:02] [V] [TRT] Tactic: -606726295133751039 Time: 0.027136
[05/21/2021-07:44:02] [V] [TRT] Fastest Tactic: 6350273239113254096 Time: 0.013332
[05/21/2021-07:44:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6350273239113254096
[05/21/2021-07:44:02] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:02] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:02] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv2 + stage3_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:44:02] [V] [TRT] Tactic: 1301213148470244380 Time: 0.024576
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:44:02] [V] [TRT] Tactic: 2140378925901736289 Time: 0.022912
[05/21/2021-07:44:02] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:44:03] [V] [TRT] Tactic: 7019285522757193163 Time: 0.03218
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:44:03] [V] [TRT] Tactic: 7616509406849244401 Time: 0.024236
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:44:03] [V] [TRT] Tactic: -6575010824547653277 Time: 0.017408
[05/21/2021-07:44:03] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.017408
[05/21/2021-07:44:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:44:03] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudaDepthwiseConvolution)
[05/21/2021-07:44:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (FusedConvActConvolution)
[05/21/2021-07:44:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:03] [V] [TRT] Tactic: 0 Time: 0.02446
[05/21/2021-07:44:03] [V] [TRT] Tactic: 1 Time: 0.024316
[05/21/2021-07:44:03] [V] [TRT] Tactic: 2 Time: 0.090448
[05/21/2021-07:44:03] [V] [TRT] Tactic: 4 Time: 0.890212
[05/21/2021-07:44:03] [V] [TRT] Tactic: 5 Time: 0.213948
[05/21/2021-07:44:03] [V] [TRT] Tactic: 56 Time: 0.024228
[05/21/2021-07:44:03] [V] [TRT] Tactic: 57 Time: 0.024324
[05/21/2021-07:44:03] [V] [TRT] Tactic: 58 Time: 0.082388
[05/21/2021-07:44:03] [V] [TRT] Tactic: 60 Time: 0.890584
[05/21/2021-07:44:03] [V] [TRT] Tactic: 61 Time: 0.211844
[05/21/2021-07:44:03] [V] [TRT] Tactic: 112 Time: 0.022492
[05/21/2021-07:44:03] [V] [TRT] Tactic: 113 Time: 0.022528
[05/21/2021-07:44:03] [V] [TRT] Tactic: 114 Time: 0.11494
[05/21/2021-07:44:03] [V] [TRT] Tactic: 116 Time: 0.891696
[05/21/2021-07:44:03] [V] [TRT] Tactic: 117 Time: 0.209968
[05/21/2021-07:44:03] [V] [TRT] Fastest Tactic: 112 Time: 0.022492
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:03] [V] [TRT] Tactic: 4549827808004681195 Time: 0.03048
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:03] [V] [TRT] Tactic: 5779835512569528575 Time: 0.037052
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:44:03] [V] [TRT] Tactic: 9151672657204310840 Time: 0.04334
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:44:03] [V] [TRT] Tactic: -7491730084094677098 Time: 0.03616
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:44:03] [V] [TRT] Tactic: -6622064180404051845 Time: 0.03968
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:03] [V] [TRT] Tactic: -6313876406580483184 Time: 0.037036
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:44:03] [V] [TRT] Tactic: -6273689210331812572 Time: 0.036736
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:44:03] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0288
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:03] [V] [TRT] Tactic: -1123676555321336786 Time: 0.036096
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:03] [V] [TRT] Tactic: -701551393537224327 Time: 0.03072
[05/21/2021-07:44:03] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.0288
[05/21/2021-07:44:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 112
[05/21/2021-07:44:03] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:03] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:03] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:03] [V] [TRT] Tactic: 1663866669559596164 Time: 0.036516
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:03] [V] [TRT] Tactic: 2860655430572478466 Time: 0.025856
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:03] [V] [TRT] Tactic: 4474630279712975759 Time: 0.01728
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:03] [V] [TRT] Tactic: 4479823862704990365 Time: 0.017024
[05/21/2021-07:44:03] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4696204239951173149 Time: 0.02454
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:04] [V] [TRT] Tactic: 5778138195697110003 Time: 0.037808
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:04] [V] [TRT] Tactic: 8918020581761223752 Time: 0.034812
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:04] [V] [TRT] Tactic: -5905193483742532701 Time: 0.022144
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:04] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016512
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:04] [V] [TRT] Tactic: -2809379259463049391 Time: 0.037256
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:04] [V] [TRT] Tactic: -1985235291706575900 Time: 0.033964
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:04] [V] [TRT] Tactic: -504296718212024303 Time: 0.034048
[05/21/2021-07:44:04] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.016512
[05/21/2021-07:44:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:04] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:44:04] [V] [TRT] Tactic: 1373022415249282411 Time: 0.028544
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:04] [V] [TRT] Tactic: 1663866669559596164 Time: 0.037352
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:04] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0248
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4474630279712975759 Time: 0.017408
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4479823862704990365 Time: 0.01704
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4696204239951173149 Time: 0.024252
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:04] [V] [TRT] Tactic: 5778138195697110003 Time: 0.037776
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:04] [V] [TRT] Tactic: 8918020581761223752 Time: 0.034816
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:44:04] [V] [TRT] Tactic: -7067026478815706014 Time: 0.025636
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:04] [V] [TRT] Tactic: -5905193483742532701 Time: 0.021504
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:04] [V] [TRT] Tactic: -4035591156787122265 Time: 0.016096
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:04] [V] [TRT] Tactic: -2809379259463049391 Time: 0.036608
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:04] [V] [TRT] Tactic: -1985235291706575900 Time: 0.035252
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:04] [V] [TRT] Tactic: -504296718212024303 Time: 0.035204
[05/21/2021-07:44:04] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.016096
[05/21/2021-07:44:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:04] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:04] [V] [TRT] Tactic: 0 Time: 0.024892
[05/21/2021-07:44:04] [V] [TRT] Tactic: 1 Time: 0.025044
[05/21/2021-07:44:04] [V] [TRT] Tactic: 2 Time: 0.087808
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4 Time: 0.882336
[05/21/2021-07:44:04] [V] [TRT] Tactic: 5 Time: 0.212352
[05/21/2021-07:44:04] [V] [TRT] Tactic: 56 Time: 0.025112
[05/21/2021-07:44:04] [V] [TRT] Tactic: 58 Time: 0.0872
[05/21/2021-07:44:04] [V] [TRT] Tactic: 60 Time: 0.882356
[05/21/2021-07:44:04] [V] [TRT] Tactic: 61 Time: 0.211372
[05/21/2021-07:44:04] [V] [TRT] Fastest Tactic: 0 Time: 0.024892
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:44:04] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (FusedConvActConvolution)
[05/21/2021-07:44:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:04] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:04] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:04] [V] [TRT] Tactic: 2195670545862694453 Time: 0.01856
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:04] [V] [TRT] Tactic: 3891805945559659536 Time: 0.025668
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:44:04] [V] [TRT] Tactic: 4418200634486186714 Time: 0.017408
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:04] [V] [TRT] Tactic: 5548126322150286555 Time: 0.018432
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:04] [V] [TRT] Tactic: 6057304366605292508 Time: 0.017792
[05/21/2021-07:44:04] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:44:04] [V] [TRT] Tactic: 7392644644614664811 Time: 0.017708
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:44:05] [V] [TRT] Tactic: -4884039206922900293 Time: 0.024576
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:05] [V] [TRT] Tactic: -4374269919094467161 Time: 0.018176
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:05] [V] [TRT] Tactic: -1546027692247304867 Time: 0.025256
[05/21/2021-07:44:05] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.017408
[05/21/2021-07:44:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:44:05] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:05] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:05] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudaDepthwiseConvolution)
[05/21/2021-07:44:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:05] [V] [TRT] Tactic: 0 Time: 0.031732
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1 Time: 0.034432
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2 Time: 0.071452
[05/21/2021-07:44:05] [V] [TRT] Tactic: 56 Time: 0.032268
[05/21/2021-07:44:05] [V] [TRT] Tactic: 58 Time: 0.070808
[05/21/2021-07:44:05] [V] [TRT] Fastest Tactic: 0 Time: 0.031732
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:05] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:05] [V] [TRT] Tactic: 254850674756030979 Time: 0.017316
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1156328698016730421 Time: 0.01288
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1362727228442059924 Time: 0.012724
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1576319725282257846 Time: 0.01008
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1832046141070096030 Time: 0.009764
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1838082074606840426 Time: 0.00968
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:05] [V] [TRT] Tactic: 1899296423087490472 Time: 0.008556
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2238656696610018305 Time: 0.009448
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2541579301352125276 Time: 0.013184
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2559328254295148085 Time: 0.017044
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00896
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:05] [V] [TRT] Tactic: 2968605903460894194 Time: 0.009856
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3071479995783211391 Time: 0.009984
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0096
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3362537467505018070 Time: 0.012288
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3513075359009385578 Time: 0.017792
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0124
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:44:05] [V] [TRT] Tactic: 3899310434460415852 Time: 0.007296
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4278315135102886928 Time: 0.009612
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4370476717970497892 Time: 0.008832
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009216
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4491683531415781597 Time: 0.016512
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4528997467275241200 Time: 0.011608
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4571819373777460444 Time: 0.01758
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4595173549602041350 Time: 0.016776
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01274
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:44:05] [V] [TRT] Tactic: 4993757826442493905 Time: 0.008872
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:05] [V] [TRT] Tactic: 5059676457552313631 Time: 0.016896
[05/21/2021-07:44:05] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:44:06] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011676
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:44:06] [V] [TRT] Tactic: 5346855796032465921 Time: 0.011384
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:06] [V] [TRT] Tactic: 5398999388616959893 Time: 0.012288
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:06] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009344
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:06] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01244
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:06] [V] [TRT] Tactic: 6468794451065529747 Time: 0.010368
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:44:06] [V] [TRT] Tactic: 6697277555581639516 Time: 0.008788
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:06] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008072
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:06] [V] [TRT] Tactic: 7216571380637776659 Time: 0.013312
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:06] [V] [TRT] Tactic: 7609923741161019135 Time: 0.009548
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:06] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008884
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:06] [V] [TRT] Tactic: 8170606396342855895 Time: 0.01018
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:44:06] [V] [TRT] Tactic: 8764780417487154889 Time: 0.01216
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:44:06] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00856
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:06] [V] [TRT] Tactic: 8839784824303350101 Time: 0.01256
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:44:06] [V] [TRT] Tactic: -9203179519031456182 Time: 0.007988
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:06] [V] [TRT] Tactic: -9009272790678027912 Time: 0.01346
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:06] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00822
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:44:06] [V] [TRT] Tactic: -8280443484414412687 Time: 0.017152
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:44:06] [V] [TRT] Tactic: -8205952393017864204 Time: 0.016908
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:44:06] [V] [TRT] Tactic: -8131857373260504832 Time: 0.009856
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:44:06] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008192
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:44:06] [V] [TRT] Tactic: -7099920365135295801 Time: 0.007544
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:44:06] [V] [TRT] Tactic: -7089118800560870395 Time: 0.008116
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:44:06] [V] [TRT] Tactic: -6768327495007644783 Time: 0.011256
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:06] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009692
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:06] [V] [TRT] Tactic: -6063766379489217211 Time: 0.009892
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:06] [V] [TRT] Tactic: -5530886555766748586 Time: 0.012208
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:44:06] [V] [TRT] Tactic: -5409588854490562130 Time: 0.008148
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:06] [V] [TRT] Tactic: -5161596964442251102 Time: 0.009856
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:06] [V] [TRT] Tactic: -5127240325355316006 Time: 0.008868
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4950923835688973492 Time: 0.007552
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01028
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4548822885169694805 Time: 0.008628
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0092
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4293222705763522367 Time: 0.007452
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:06] [V] [TRT] Tactic: -4152066959007262150 Time: 0.017384
[05/21/2021-07:44:06] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:07] [V] [TRT] Tactic: -4021926646879732549 Time: 0.009984
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3987638434926559037 Time: 0.010368
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3905653247016903130 Time: 0.01292
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3903342530518878192 Time: 0.012544
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3864869056275745423 Time: 0.012692
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008192
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3058330359340425555 Time: 0.009376
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:44:07] [V] [TRT] Tactic: -2878731503146438856 Time: 0.010752
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:44:07] [V] [TRT] Tactic: -2602982885923184927 Time: 0.01176
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:44:07] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012288
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:44:07] [V] [TRT] Tactic: -2032577876140256150 Time: 0.009676
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:44:07] [V] [TRT] Tactic: -2003055242756584050 Time: 0.009088
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01288
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1828674067637788567 Time: 0.010144
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1640527254204634147 Time: 0.009728
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1562548049711204899 Time: 0.012032
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1242202084391243207 Time: 0.009264
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008296
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:44:07] [V] [TRT] Tactic: -1038291877007553549 Time: 0.009636
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:44:07] [V] [TRT] Tactic: -406984317033388136 Time: 0.012212
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:44:07] [V] [TRT] Tactic: -331499326992534460 Time: 0.008432
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:44:07] [V] [TRT] Tactic: -206523504474952360 Time: 0.011352
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.007296
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CudnnConvolution)
[05/21/2021-07:44:07] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CublasConvolution)
[05/21/2021-07:44:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit2_conv3 + _plus8 (CaskConvolution)
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:44:07] [V] [TRT] Tactic: 162720039126739803 Time: 0.009344
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:44:07] [V] [TRT] Tactic: 382577144988222004 Time: 0.009856
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:44:07] [V] [TRT] Tactic: 2334614616543277495 Time: 0.009984
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:44:07] [V] [TRT] Tactic: 4126996489741716394 Time: 0.00746
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:44:07] [V] [TRT] Tactic: 6466136707377588846 Time: 0.007384
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:44:07] [V] [TRT] Tactic: 6958123061428231366 Time: 0.007508
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:44:07] [V] [TRT] Tactic: 8940522081427638481 Time: 0.007768
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:44:07] [V] [TRT] Tactic: -7023377647582255231 Time: 0.007296
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:44:07] [V] [TRT] Tactic: -6148657501329441429 Time: 0.00768
[05/21/2021-07:44:07] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:44:07] [V] [TRT] Tactic: -3396930063803107917 Time: 0.00738
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: -7023377647582255231 Time: 0.007296
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7023377647582255231
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Tactic: 0 Time: 0.004696
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004696
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Tactic: 0 Time: 0.004132
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004132
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Tactic: 0 Time: 0.005548
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005548
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Tactic: 0 Time: 0.005808
[05/21/2021-07:44:07] [V] [TRT] Fastest Tactic: 0 Time: 0.005808
[05/21/2021-07:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:07] [V] [TRT] --------------- Timing Runner: stage3_unit3_bn1 + stage3_unit3_relu1 (Scale)
[05/21/2021-07:44:07] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:07] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv1 + stage3_unit3_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv2 + stage3_unit3_relu3 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit3_conv3 + _plus9 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.00484
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00484
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.0058
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0058
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_bn1 + stage3_unit4_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv1 + stage3_unit4_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv2 + stage3_unit4_relu3 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit4_conv3 + _plus10 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.00438
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00438
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.00482
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00482
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Tactic: 0 Time: 0.005556
[05/21/2021-07:44:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005556
[05/21/2021-07:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_bn1 + stage3_unit5_relu1 (Scale)
[05/21/2021-07:44:08] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv1 + stage3_unit5_relu2 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv2 + stage3_unit5_relu3 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CudnnConvolution)
[05/21/2021-07:44:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CublasConvolution)
[05/21/2021-07:44:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit5_conv3 + _plus11 (CaskConvolution)
[05/21/2021-07:44:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:08] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:08] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.00474
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00474
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.004844
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004844
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_bn1 + stage3_unit6_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CaskConvolution)
[05/21/2021-07:44:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CudnnConvolution)
[05/21/2021-07:44:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CublasConvolution)
[05/21/2021-07:44:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv1 + stage3_unit6_relu2 (CaskConvolution)
[05/21/2021-07:44:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256) -> Float(50176,1,3584,256) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64) -> Float(12544,1:4,896,64) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1) -> Half(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1) -> Half(25088,196:2,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Float(50176,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CudnnConvolution)
[05/21/2021-07:44:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv2 + stage3_unit6_relu3 (CaskConvolution)
[05/21/2021-07:44:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32) -> Half(6272,1:8,448,32) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16) -> Half(3136,1:16,224,16) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,196,14,1), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,1,3584,256), Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(12544,1:4,896,64), Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(50176,196,14,1), Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,196:2,14,1), Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CudnnConvolution)
[05/21/2021-07:44:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CublasConvolution)
[05/21/2021-07:44:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage3_unit6_conv3 + _plus12 (CaskConvolution)
[05/21/2021-07:44:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(6272,1:8,448,32), Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(3136,1:16,224,16), Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.004492
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.004492
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(200704,1,14336,1024) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(50176,1:4,3584,256) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(200704,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.005504
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005504
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196:2,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(25088,1:8,1792,128) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:44:09] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:44:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(12544,1:16,896,64) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_bn1 + stage4_unit1_relu1 (Scale)
[05/21/2021-07:44:09] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1) -> Float(100352,196,14,1) ***************
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:44:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:09] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:44:09] [V] [TRT] Tactic: 589823 Time: 0.26624
[05/21/2021-07:44:09] [V] [TRT] Tactic: 655359 Time: 0.161792
[05/21/2021-07:44:09] [V] [TRT] Tactic: 786431 Time: 0.061312
[05/21/2021-07:44:09] [V] [TRT] Tactic: 851967 Time: 0.048632
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1179647 Time: 0.03584
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1310719 Time: 0.112
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1376255 Time: 0.178816
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1441791 Time: 0.030352
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1507327 Time: 0.075496
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1638399 Time: 0.037668
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1835007 Time: 0.059392
[05/21/2021-07:44:09] [V] [TRT] Tactic: 1900543 Time: 0.144512
[05/21/2021-07:44:09] [V] [TRT] Tactic: 2097151 Time: 0.030464
[05/21/2021-07:44:09] [V] [TRT] Tactic: 2162687 Time: 0.180572
[05/21/2021-07:44:09] [V] [TRT] Tactic: 2293759 Time: 0.16824
[05/21/2021-07:44:09] [V] [TRT] Tactic: 2359295 Time: 0.097972
[05/21/2021-07:44:09] [V] [TRT] Tactic: 2686975 Time: 0.172064
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3080191 Time: 0.081716
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3342335 Time: 0.091136
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3407871 Time: 0.089216
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3538943 Time: 0.050708
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3670015 Time: 0.328836
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3932159 Time: 0.145408
[05/21/2021-07:44:09] [V] [TRT] Tactic: 3997695 Time: 0.035868
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4063231 Time: 0.043008
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4194303 Time: 0.054952
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4259839 Time: 0.032768
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4325375 Time: 0.044396
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4521983 Time: 0.132088
[05/21/2021-07:44:09] [V] [TRT] Tactic: 4587519 Time: 0.038596
[05/21/2021-07:44:10] [V] [TRT] Tactic: 4653055 Time: 0.032448
[05/21/2021-07:44:10] [V] [TRT] Tactic: 4915199 Time: 0.038144
[05/21/2021-07:44:10] [V] [TRT] Tactic: 4980735 Time: 0.0885
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5177343 Time: 0.0384
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5242879 Time: 0.083628
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5373951 Time: 0.03904
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5439487 Time: 0.052124
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5570559 Time: 0.073388
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5636095 Time: 0.0445
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5701631 Time: 0.164892
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5767167 Time: 0.092572
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5832703 Time: 0.090112
[05/21/2021-07:44:10] [V] [TRT] Tactic: 5898239 Time: 0.031912
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6029311 Time: 0.162208
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6225919 Time: 0.049152
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6291455 Time: 0.036096
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6422527 Time: 0.081804
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6750207 Time: 0.038804
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6815743 Time: 0.0894
[05/21/2021-07:44:10] [V] [TRT] Tactic: 6946815 Time: 0.058376
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7012351 Time: 0.030892
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7077887 Time: 0.048044
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7143423 Time: 0.074852
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7208959 Time: 0.072704
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7340031 Time: 0.030132
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7405567 Time: 0.043396
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7536639 Time: 0.147632
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7602175 Time: 0.056236
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7733247 Time: 0.05312
[05/21/2021-07:44:10] [V] [TRT] Tactic: 7798783 Time: 0.059932
[05/21/2021-07:44:10] [V] [TRT] Tactic: 8191999 Time: 0.057244
[05/21/2021-07:44:10] [V] [TRT] Tactic: 8257535 Time: 0.038804
[05/21/2021-07:44:10] [V] [TRT] Tactic: 8323071 Time: 0.05888
[05/21/2021-07:44:10] [V] [TRT] Tactic: 8650751 Time: 0.058284
[05/21/2021-07:44:10] [V] [TRT] Tactic: 8716287 Time: 0.050816
[05/21/2021-07:44:10] [V] [TRT] Tactic: 9109503 Time: 0.032256
[05/21/2021-07:44:10] [V] [TRT] Tactic: 9568255 Time: 0.038448
[05/21/2021-07:44:10] [V] [TRT] Tactic: 9895935 Time: 0.05504
[05/21/2021-07:44:10] [V] [TRT] Tactic: 10223615 Time: 0.136052
[05/21/2021-07:44:10] [V] [TRT] Tactic: 10354687 Time: 0.03832
[05/21/2021-07:44:10] [V] [TRT] Tactic: 10551295 Time: 0.078628
[05/21/2021-07:44:10] [V] [TRT] Tactic: 10747903 Time: 0.044388
[05/21/2021-07:44:11] [V] [TRT] Tactic: 10944511 Time: 0.089984
[05/21/2021-07:44:11] [V] [TRT] Fastest Tactic: 7340031 Time: 0.030132
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:11] [V] [TRT] Tactic: 0 Time: 0.066944
[05/21/2021-07:44:11] [V] [TRT] Tactic: 1 Time: 0.053808
[05/21/2021-07:44:11] [V] [TRT] Tactic: 2 Time: 0.161796
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4 Time: 1.74887
[05/21/2021-07:44:11] [V] [TRT] Tactic: 5 Time: 0.393168
[05/21/2021-07:44:11] [V] [TRT] Tactic: 56 Time: 0.065536
[05/21/2021-07:44:11] [V] [TRT] Tactic: 57 Time: 0.05306
[05/21/2021-07:44:11] [V] [TRT] Tactic: 58 Time: 0.161152
[05/21/2021-07:44:11] [V] [TRT] Tactic: 60 Time: 1.74911
[05/21/2021-07:44:11] [V] [TRT] Tactic: 61 Time: 0.393556
[05/21/2021-07:44:11] [V] [TRT] Tactic: 112 Time: 0.066432
[05/21/2021-07:44:11] [V] [TRT] Tactic: 113 Time: 0.052864
[05/21/2021-07:44:11] [V] [TRT] Tactic: 114 Time: 0.161156
[05/21/2021-07:44:11] [V] [TRT] Tactic: 116 Time: 1.74906
[05/21/2021-07:44:11] [V] [TRT] Tactic: 117 Time: 0.393548
[05/21/2021-07:44:11] [V] [TRT] Fastest Tactic: 113 Time: 0.052864
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4549827808004681195 Time: 0.092672
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:11] [V] [TRT] Tactic: 5779835512569528575 Time: 0.115852
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:44:11] [V] [TRT] Tactic: 9151672657204310840 Time: 0.095616
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:44:11] [V] [TRT] Tactic: -7491730084094677098 Time: 0.112704
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:44:11] [V] [TRT] Tactic: -6622064180404051845 Time: 0.107648
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:11] [V] [TRT] Tactic: -6313876406580483184 Time: 0.132352
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:44:11] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115584
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:44:11] [V] [TRT] Tactic: -4337126844824617177 Time: 0.086528
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:11] [V] [TRT] Tactic: -1123676555321336786 Time: 0.116036
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:11] [V] [TRT] Tactic: -701551393537224327 Time: 0.096512
[05/21/2021-07:44:11] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.086528
[05/21/2021-07:44:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7340031
[05/21/2021-07:44:11] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024) -> Float(100352,1,7168,512) ***************
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:11] [V] [TRT] Tactic: 1663866669559596164 Time: 0.124164
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:11] [V] [TRT] Tactic: 2860655430572478466 Time: 0.07064
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4474630279712975759 Time: 0.040864
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4479823862704990365 Time: 0.039728
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4696204239951173149 Time: 0.06902
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:11] [V] [TRT] Tactic: 5778138195697110003 Time: 0.124024
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:11] [V] [TRT] Tactic: 8918020581761223752 Time: 0.113536
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:11] [V] [TRT] Tactic: -5905193483742532701 Time: 0.063048
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:11] [V] [TRT] Tactic: -4035591156787122265 Time: 0.03978
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:11] [V] [TRT] Tactic: -2809379259463049391 Time: 0.12416
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:11] [V] [TRT] Tactic: -1985235291706575900 Time: 0.112
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:11] [V] [TRT] Tactic: -504296718212024303 Time: 0.113536
[05/21/2021-07:44:11] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.039728
[05/21/2021-07:44:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:44:11] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256) -> Float(25088,1:4,1792,128) ***************
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:11] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:44:11] [V] [TRT] Tactic: 1373022415249282411 Time: 0.082944
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:11] [V] [TRT] Tactic: 1663866669559596164 Time: 0.124064
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:11] [V] [TRT] Tactic: 2860655430572478466 Time: 0.070784
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4474630279712975759 Time: 0.039984
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4479823862704990365 Time: 0.039552
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:11] [V] [TRT] Tactic: 4696204239951173149 Time: 0.068864
[05/21/2021-07:44:11] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:12] [V] [TRT] Tactic: 5778138195697110003 Time: 0.126976
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:12] [V] [TRT] Tactic: 8918020581761223752 Time: 0.112896
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:44:12] [V] [TRT] Tactic: -7067026478815706014 Time: 0.082812
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:12] [V] [TRT] Tactic: -5905193483742532701 Time: 0.061844
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:12] [V] [TRT] Tactic: -4035591156787122265 Time: 0.039488
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:12] [V] [TRT] Tactic: -2809379259463049391 Time: 0.123552
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:12] [V] [TRT] Tactic: -1985235291706575900 Time: 0.111744
[05/21/2021-07:44:12] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:12] [V] [TRT] Tactic: -504296718212024303 Time: 0.111988
[05/21/2021-07:44:12] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.039488
[05/21/2021-07:44:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:12] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1) -> Half(100352,196,14,1) ***************
[05/21/2021-07:44:12] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:12] [V] [TRT] Tactic: 0 Time: 0.056704
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1 Time: 0.05558
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2 Time: 0.106496
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4 Time: 1.73507
[05/21/2021-07:44:12] [V] [TRT] Tactic: 5 Time: 0.38176
[05/21/2021-07:44:12] [V] [TRT] Tactic: 56 Time: 0.059392
[05/21/2021-07:44:12] [V] [TRT] Tactic: 58 Time: 0.114176
[05/21/2021-07:44:12] [V] [TRT] Tactic: 60 Time: 1.73212
[05/21/2021-07:44:12] [V] [TRT] Tactic: 61 Time: 0.382472
[05/21/2021-07:44:12] [V] [TRT] Fastest Tactic: 1 Time: 0.05558
[05/21/2021-07:44:12] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:12] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:44:12] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(100352,196,14,1) ***************
[05/21/2021-07:44:12] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:12] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1) -> Half(50176,196:2,14,1) ***************
[05/21/2021-07:44:12] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (FusedConvActConvolution)
[05/21/2021-07:44:12] [V] [TRT] Tactic: 589823 Time: 0.11264
[05/21/2021-07:44:12] [V] [TRT] Tactic: 655359 Time: 0.080768
[05/21/2021-07:44:12] [V] [TRT] Tactic: 786431 Time: 0.030904
[05/21/2021-07:44:12] [V] [TRT] Tactic: 851967 Time: 0.026496
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1179647 Time: 0.021376
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1310719 Time: 0.057792
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1376255 Time: 0.083244
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1441791 Time: 0.019528
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1507327 Time: 0.045492
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1638399 Time: 0.023192
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1835007 Time: 0.031368
[05/21/2021-07:44:12] [V] [TRT] Tactic: 1900543 Time: 0.087072
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2097151 Time: 0.019108
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2162687 Time: 0.086424
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2293759 Time: 0.075392
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2359295 Time: 0.0472
[05/21/2021-07:44:12] [V] [TRT] Tactic: 2686975 Time: 0.07744
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3080191 Time: 0.040668
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3342335 Time: 0.04626
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3407871 Time: 0.040824
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3538943 Time: 0.024932
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3670015 Time: 0.156204
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3932159 Time: 0.065664
[05/21/2021-07:44:12] [V] [TRT] Tactic: 3997695 Time: 0.022528
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4063231 Time: 0.025728
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4194303 Time: 0.029696
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4259839 Time: 0.019456
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4325375 Time: 0.023784
[05/21/2021-07:44:12] [V] [TRT] Tactic: 4521983 Time: 0.075776
[05/21/2021-07:44:13] [V] [TRT] Tactic: 4587519 Time: 0.020864
[05/21/2021-07:44:13] [V] [TRT] Tactic: 4653055 Time: 0.019856
[05/21/2021-07:44:13] [V] [TRT] Tactic: 4915199 Time: 0.021264
[05/21/2021-07:44:13] [V] [TRT] Tactic: 4980735 Time: 0.038912
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5177343 Time: 0.021668
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5242879 Time: 0.038916
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5373951 Time: 0.022016
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5439487 Time: 0.030252
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5570559 Time: 0.045056
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5636095 Time: 0.026124
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5701631 Time: 0.073088
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5767167 Time: 0.042368
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5832703 Time: 0.042008
[05/21/2021-07:44:13] [V] [TRT] Tactic: 5898239 Time: 0.02048
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6029311 Time: 0.069248
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6225919 Time: 0.023552
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6291455 Time: 0.020928
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6422527 Time: 0.037888
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6750207 Time: 0.023552
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6815743 Time: 0.042032
[05/21/2021-07:44:13] [V] [TRT] Tactic: 6946815 Time: 0.031364
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7012351 Time: 0.019076
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7077887 Time: 0.025472
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7143423 Time: 0.041988
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7208959 Time: 0.043264
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7340031 Time: 0.020864
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7405567 Time: 0.023424
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7536639 Time: 0.063772
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7602175 Time: 0.030232
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7733247 Time: 0.027648
[05/21/2021-07:44:13] [V] [TRT] Tactic: 7798783 Time: 0.031188
[05/21/2021-07:44:13] [V] [TRT] Tactic: 8191999 Time: 0.030392
[05/21/2021-07:44:13] [V] [TRT] Tactic: 8257535 Time: 0.021504
[05/21/2021-07:44:13] [V] [TRT] Tactic: 8323071 Time: 0.028672
[05/21/2021-07:44:13] [V] [TRT] Tactic: 8650751 Time: 0.030392
[05/21/2021-07:44:13] [V] [TRT] Tactic: 8716287 Time: 0.025984
[05/21/2021-07:44:13] [V] [TRT] Tactic: 9109503 Time: 0.0192
[05/21/2021-07:44:13] [V] [TRT] Tactic: 9568255 Time: 0.02112
[05/21/2021-07:44:13] [V] [TRT] Tactic: 9895935 Time: 0.030372
[05/21/2021-07:44:13] [V] [TRT] Tactic: 10223615 Time: 0.077312
[05/21/2021-07:44:14] [V] [TRT] Tactic: 10354687 Time: 0.020784
[05/21/2021-07:44:14] [V] [TRT] Tactic: 10551295 Time: 0.045656
[05/21/2021-07:44:14] [V] [TRT] Tactic: 10747903 Time: 0.027016
[05/21/2021-07:44:14] [V] [TRT] Tactic: 10944511 Time: 0.039224
[05/21/2021-07:44:14] [V] [TRT] Fastest Tactic: 7012351 Time: 0.019076
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2195670545862694453 Time: 0.054576
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3891805945559659536 Time: 0.076712
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:44:14] [V] [TRT] Tactic: 4418200634486186714 Time: 0.045796
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:14] [V] [TRT] Tactic: 5548126322150286555 Time: 0.050236
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:14] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048396
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:44:14] [V] [TRT] Tactic: 7392644644614664811 Time: 0.04608
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:44:14] [V] [TRT] Tactic: -4884039206922900293 Time: 0.076672
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:14] [V] [TRT] Tactic: -4374269919094467161 Time: 0.049536
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:14] [V] [TRT] Tactic: -1546027692247304867 Time: 0.077696
[05/21/2021-07:44:14] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.045796
[05/21/2021-07:44:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[05/21/2021-07:44:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Float(100352,196,14,1) ***************
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128) -> Half(12544,1:8,896,64) ***************
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:44:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:14] [V] [TRT] Tactic: 0 Time: 0.081536
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1 Time: 0.067592
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2 Time: 0.109056
[05/21/2021-07:44:14] [V] [TRT] Tactic: 56 Time: 0.081408
[05/21/2021-07:44:14] [V] [TRT] Tactic: 58 Time: 0.108884
[05/21/2021-07:44:14] [V] [TRT] Fastest Tactic: 1 Time: 0.067592
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:14] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:14] [V] [TRT] Tactic: 254850674756030979 Time: 0.04224
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1156328698016730421 Time: 0.026456
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1362727228442059924 Time: 0.030252
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1576319725282257846 Time: 0.015916
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1832046141070096030 Time: 0.016128
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1838082074606840426 Time: 0.015668
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:14] [V] [TRT] Tactic: 1899296423087490472 Time: 0.011436
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2238656696610018305 Time: 0.015488
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2541579301352125276 Time: 0.024992
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2559328254295148085 Time: 0.042368
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2657157263811141609 Time: 0.011264
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:14] [V] [TRT] Tactic: 2968605903460894194 Time: 0.015388
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0097
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3359475309458902373 Time: 0.014324
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3362537467505018070 Time: 0.025216
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3513075359009385578 Time: 0.044096
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3704534001553878387 Time: 0.025728
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:44:14] [V] [TRT] Tactic: 3899310434460415852 Time: 0.010496
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:14] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01566
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:44:14] [V] [TRT] Tactic: 4370476717970497892 Time: 0.015252
[05/21/2021-07:44:14] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4480294673430783793 Time: 0.015204
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4491683531415781597 Time: 0.042004
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4528997467275241200 Time: 0.022912
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4571819373777460444 Time: 0.04236
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4595173549602041350 Time: 0.042416
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4802447371470387646 Time: 0.027008
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:44:15] [V] [TRT] Tactic: 4993757826442493905 Time: 0.015392
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:15] [V] [TRT] Tactic: 5059676457552313631 Time: 0.04216
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:44:15] [V] [TRT] Tactic: 5205510332404400949 Time: 0.024448
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:44:15] [V] [TRT] Tactic: 5346855796032465921 Time: 0.025344
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:15] [V] [TRT] Tactic: 5398999388616959893 Time: 0.025796
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:15] [V] [TRT] Tactic: 6034364043891107501 Time: 0.01514
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:15] [V] [TRT] Tactic: 6377497238381488891 Time: 0.02436
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:15] [V] [TRT] Tactic: 6468794451065529747 Time: 0.016012
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:44:15] [V] [TRT] Tactic: 6697277555581639516 Time: 0.014276
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:15] [V] [TRT] Tactic: 6859477213531075460 Time: 0.01024
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:15] [V] [TRT] Tactic: 7216571380637776659 Time: 0.029772
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:15] [V] [TRT] Tactic: 7609923741161019135 Time: 0.01536
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:15] [V] [TRT] Tactic: 8101703987960976805 Time: 0.011784
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:15] [V] [TRT] Tactic: 8170606396342855895 Time: 0.016384
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:44:15] [V] [TRT] Tactic: 8764780417487154889 Time: 0.02576
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:44:15] [V] [TRT] Tactic: 8823554289762712606 Time: 0.015488
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:15] [V] [TRT] Tactic: 8839784824303350101 Time: 0.027544
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:44:15] [V] [TRT] Tactic: -9203179519031456182 Time: 0.010752
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:15] [V] [TRT] Tactic: -9009272790678027912 Time: 0.027768
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:15] [V] [TRT] Tactic: -8604374562669615024 Time: 0.011264
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:44:15] [V] [TRT] Tactic: -8280443484414412687 Time: 0.042516
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:44:15] [V] [TRT] Tactic: -8205952393017864204 Time: 0.042112
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:44:15] [V] [TRT] Tactic: -8131857373260504832 Time: 0.015888
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:44:15] [V] [TRT] Tactic: -7410012245391920273 Time: 0.011652
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:44:15] [V] [TRT] Tactic: -7099920365135295801 Time: 0.014624
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:44:15] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0113
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:44:15] [V] [TRT] Tactic: -6768327495007644783 Time: 0.024532
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:15] [V] [TRT] Tactic: -6356316196810535311 Time: 0.011924
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:15] [V] [TRT] Tactic: -6063766379489217211 Time: 0.015468
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:15] [V] [TRT] Tactic: -5530886555766748586 Time: 0.024576
[05/21/2021-07:44:15] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:44:16] [V] [TRT] Tactic: -5409588854490562130 Time: 0.01068
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:16] [V] [TRT] Tactic: -5161596964442251102 Time: 0.01536
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:16] [V] [TRT] Tactic: -5127240325355316006 Time: 0.01514
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4950923835688973492 Time: 0.010384
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4796511246675321840 Time: 0.016208
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4548822885169694805 Time: 0.011292
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4379519430184503304 Time: 0.015536
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4293222705763522367 Time: 0.011264
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4152066959007262150 Time: 0.043468
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:16] [V] [TRT] Tactic: -4021926646879732549 Time: 0.01536
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3987638434926559037 Time: 0.015516
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3905653247016903130 Time: 0.025888
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3903342530518878192 Time: 0.024996
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3864869056275745423 Time: 0.025984
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011292
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:16] [V] [TRT] Tactic: -3058330359340425555 Time: 0.01562
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:44:16] [V] [TRT] Tactic: -2878731503146438856 Time: 0.024872
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:44:16] [V] [TRT] Tactic: -2602982885923184927 Time: 0.023808
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:44:16] [V] [TRT] Tactic: -2353603993968373338 Time: 0.026936
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:44:16] [V] [TRT] Tactic: -2032577876140256150 Time: 0.015876
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:44:16] [V] [TRT] Tactic: -2003055242756584050 Time: 0.01458
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1985778916402815946 Time: 0.026624
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1828674067637788567 Time: 0.009728
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1640527254204634147 Time: 0.016172
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1562548049711204899 Time: 0.02496
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1242202084391243207 Time: 0.015232
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1099247066487349374 Time: 0.011392
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:44:16] [V] [TRT] Tactic: -1038291877007553549 Time: 0.015408
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:44:16] [V] [TRT] Tactic: -406984317033388136 Time: 0.025348
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:44:16] [V] [TRT] Tactic: -331499326992534460 Time: 0.015104
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:44:16] [V] [TRT] Tactic: -206523504474952360 Time: 0.024992
[05/21/2021-07:44:16] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.0097
[05/21/2021-07:44:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391
[05/21/2021-07:44:16] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64) -> Half(6272,1:16,448,32) ***************
[05/21/2021-07:44:16] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CudnnConvolution)
[05/21/2021-07:44:16] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:16] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CublasConvolution)
[05/21/2021-07:44:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:16] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv1 + stage4_unit1_relu2 (CaskConvolution)
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:44:16] [V] [TRT] Tactic: 162720039126739803 Time: 0.010468
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:44:16] [V] [TRT] Tactic: 382577144988222004 Time: 0.014336
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:44:16] [V] [TRT] Tactic: 2334614616543277495 Time: 0.015872
[05/21/2021-07:44:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:44:17] [V] [TRT] Tactic: 4126996489741716394 Time: 0.010624
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:44:17] [V] [TRT] Tactic: 6466136707377588846 Time: 0.009472
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:44:17] [V] [TRT] Tactic: 6958123061428231366 Time: 0.010368
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:44:17] [V] [TRT] Tactic: 8940522081427638481 Time: 0.011264
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:44:17] [V] [TRT] Tactic: -7023377647582255231 Time: 0.009776
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:44:17] [V] [TRT] Tactic: -6148657501329441429 Time: 0.010904
[05/21/2021-07:44:17] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:44:17] [V] [TRT] Tactic: -3396930063803107917 Time: 0.00964
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 6466136707377588846 Time: 0.009472
[05/21/2021-07:44:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6466136707377588846
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.010368
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.009368
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005276
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005276
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.026368
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004112
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004112
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,196,14,1) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.010932
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005288
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005288
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.008228
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005284
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005284
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.00722
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004468
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004468
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,7168,512) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.00428
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00428
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.01024
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005108
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005108
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004752
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004752
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007196
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,1792,128) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006104
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.0265
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004312
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004312
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006988
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005204
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005204
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.006184
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.009216
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007436
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,196,14,1) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.008868
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.00576
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00576
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004068
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004068
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007316
[05/21/2021-07:44:17] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:17] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:17] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:17] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.011008
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004072
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004072
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,196:2,14,1) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004804
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004804
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.006276
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004328
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004328
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.005268
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005268
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.008768
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007252
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,896,64) -> Half(6272,1:16,448,32) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.006624
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(100352,196,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.005276
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005276
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(100352,1,7168,512) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.006324
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004612
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004612
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Float(25088,1:4,1792,128) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(100352,196,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.008876
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(50176,196:2,14,1) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.005296
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005296
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,448,32) -> Half(12544,1:8,896,64) (Reformat)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.00436
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00436
[05/21/2021-07:44:18] [V] [TRT] *************** Autotuning format combination: Float(100352,196,14,1) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 458751 Time: 0.331048
[05/21/2021-07:44:18] [V] [TRT] Fastest Tactic: 458751 Time: 0.331048
[05/21/2021-07:44:18] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:18] [V] [TRT] Tactic: 0 Time: 0.278536
[05/21/2021-07:44:18] [V] [TRT] Tactic: 1 Time: 0.092616
[05/21/2021-07:44:18] [V] [TRT] Tactic: 2 Time: 0.305664
[05/21/2021-07:44:18] [V] [TRT] Tactic: 5 Time: 3.20426
[05/21/2021-07:44:18] [V] [TRT] Tactic: 56 Time: 0.278656
[05/21/2021-07:44:18] [V] [TRT] Tactic: 57 Time: 0.092672
[05/21/2021-07:44:18] [V] [TRT] Tactic: 58 Time: 0.305832
[05/21/2021-07:44:19] [V] [TRT] Tactic: 61 Time: 3.19708
[05/21/2021-07:44:19] [V] [TRT] Tactic: 112 Time: 0.279552
[05/21/2021-07:44:19] [V] [TRT] Tactic: 113 Time: 0.27904
[05/21/2021-07:44:19] [V] [TRT] Tactic: 114 Time: 0.306048
[05/21/2021-07:44:19] [V] [TRT] Tactic: 117 Time: 3.19932
[05/21/2021-07:44:19] [V] [TRT] Fastest Tactic: 1 Time: 0.092616
[05/21/2021-07:44:19] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4549827808004681195 Time: 0.388252
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:19] [V] [TRT] Tactic: 5779835512569528575 Time: 0.496128
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:44:19] [V] [TRT] Tactic: 6053873026024413720 Time: 0.500528
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:44:19] [V] [TRT] Tactic: 6767548733843469815 Time: 0.403456
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:19] [V] [TRT] Tactic: -6313876406580483184 Time: 0.587276
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:19] [V] [TRT] Tactic: -1123676555321336786 Time: 0.49436
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:19] [V] [TRT] Tactic: -701551393537224327 Time: 0.427764
[05/21/2021-07:44:19] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.388252
[05/21/2021-07:44:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:44:19] [V] [TRT] *************** Autotuning format combination: Float(100352,1,7168,512) -> Float(25088,1,3584,512) ***************
[05/21/2021-07:44:19] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:19] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:19] [V] [TRT] Tactic: 2860655430572478466 Time: 0.289572
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4474630279712975759 Time: 0.156544
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4479823862704990365 Time: 0.15376
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4696204239951173149 Time: 0.289836
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:19] [V] [TRT] Tactic: 5778138195697110003 Time: 0.49628
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:44:19] [V] [TRT] Tactic: 7155825427510256858 Time: 0.486016
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:19] [V] [TRT] Tactic: 8918020581761223752 Time: 0.477312
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:44:19] [V] [TRT] Tactic: -4756382386362004279 Time: 0.284076
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:44:19] [V] [TRT] Tactic: -3855385237722507464 Time: 0.498944
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:19] [V] [TRT] Tactic: -2809379259463049391 Time: 0.490604
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:19] [V] [TRT] Tactic: -504296718212024303 Time: 0.478508
[05/21/2021-07:44:19] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.15376
[05/21/2021-07:44:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:44:19] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,1792,128) -> Float(6272,1:4,896,128) ***************
[05/21/2021-07:44:19] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:19] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:19] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:19] [V] [TRT] Tactic: 2860655430572478466 Time: 0.289396
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4474630279712975759 Time: 0.156288
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4479823862704990365 Time: 0.153812
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:19] [V] [TRT] Tactic: 4696204239951173149 Time: 0.289664
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:19] [V] [TRT] Tactic: 5778138195697110003 Time: 0.496512
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:44:19] [V] [TRT] Tactic: 7155825427510256858 Time: 0.485656
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:44:19] [V] [TRT] Tactic: 7342025736444949634 Time: 0.33536
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:19] [V] [TRT] Tactic: 8918020581761223752 Time: 0.476928
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:44:19] [V] [TRT] Tactic: -7377458734869418330 Time: 0.323456
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:44:19] [V] [TRT] Tactic: -5457304872213719461 Time: 0.326528
[05/21/2021-07:44:19] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:44:20] [V] [TRT] Tactic: -4756382386362004279 Time: 0.284032
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:44:20] [V] [TRT] Tactic: -3855385237722507464 Time: 0.499328
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:20] [V] [TRT] Tactic: -2809379259463049391 Time: 0.489564
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:20] [V] [TRT] Tactic: -504296718212024303 Time: 0.479284
[05/21/2021-07:44:20] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.153812
[05/21/2021-07:44:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:44:20] [V] [TRT] *************** Autotuning format combination: Half(100352,196,14,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:20] [V] [TRT] Tactic: 0 Time: 0.315056
[05/21/2021-07:44:20] [V] [TRT] Tactic: 1 Time: 0.314808
[05/21/2021-07:44:20] [V] [TRT] Tactic: 2 Time: 0.246456
[05/21/2021-07:44:20] [V] [TRT] Tactic: 5 Time: 3.14832
[05/21/2021-07:44:20] [V] [TRT] Tactic: 56 Time: 0.316408
[05/21/2021-07:44:20] [V] [TRT] Tactic: 58 Time: 0.248064
[05/21/2021-07:44:20] [V] [TRT] Tactic: 61 Time: 3.14043
[05/21/2021-07:44:20] [V] [TRT] Fastest Tactic: 2 Time: 0.246456
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
[05/21/2021-07:44:20] [V] [TRT] *************** Autotuning format combination: Half(50176,196:2,14,1) -> Half(12544,49:2,7,1) ***************
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (FusedConvActConvolution)
[05/21/2021-07:44:20] [V] [TRT] Tactic: 458751 Time: 0.150528
[05/21/2021-07:44:20] [V] [TRT] Fastest Tactic: 458751 Time: 0.150528
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:20] [V] [TRT] Tactic: 2195670545862694453 Time: 0.259376
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:44:20] [V] [TRT] Tactic: 3419182076704469245 Time: 0.22912
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:20] [V] [TRT] Tactic: 3891805945559659536 Time: 0.319488
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:20] [V] [TRT] Tactic: 5548126322150286555 Time: 0.218284
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:20] [V] [TRT] Tactic: 6057304366605292508 Time: 0.1984
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:44:20] [V] [TRT] Tactic: -7928611605886347652 Time: 0.3318
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:44:20] [V] [TRT] Tactic: -5172391392092686714 Time: 0.272012
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:20] [V] [TRT] Tactic: -4374269919094467161 Time: 0.215492
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:20] [V] [TRT] Tactic: -1546027692247304867 Time: 0.323036
[05/21/2021-07:44:20] [V] [TRT] Fastest Tactic: 6057304366605292508 Time: 0.1984
[05/21/2021-07:44:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751
[05/21/2021-07:44:20] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,896,64) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:20] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,896,64) -> Half(3136,1:8,448,64) ***************
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:20] [V] [TRT] Tactic: 0 Time: 0.277952
[05/21/2021-07:44:20] [V] [TRT] Tactic: 1 Time: 0.276792
[05/21/2021-07:44:20] [V] [TRT] Tactic: 2 Time: 0.241324
[05/21/2021-07:44:20] [V] [TRT] Tactic: 56 Time: 0.276644
[05/21/2021-07:44:20] [V] [TRT] Tactic: 58 Time: 0.2418
[05/21/2021-07:44:20] [V] [TRT] Fastest Tactic: 2 Time: 0.241324
[05/21/2021-07:44:20] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:20] [V] [TRT] Tactic: 254850674756030979 Time: 0.165164
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:44:20] [V] [TRT] Tactic: 328038211831149625 Time: 0.162088
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:44:20] [V] [TRT] Tactic: 411553864378931917 Time: 0.045824
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:44:20] [V] [TRT] Tactic: 1011057357468998345 Time: 0.091776
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:20] [V] [TRT] Tactic: 1156328698016730421 Time: 0.096916
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:44:20] [V] [TRT] Tactic: 1723736032573714698 Time: 0.04608
[05/21/2021-07:44:20] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:21] [V] [TRT] Tactic: 1832046141070096030 Time: 0.045696
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:21] [V] [TRT] Tactic: 1838082074606840426 Time: 0.045056
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:21] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0256
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2428167804343994714 Time: 0.048064
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2541579301352125276 Time: 0.093492
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2657157263811141609 Time: 0.027684
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2819719497590964443 Time: 0.047488
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2968605903460894194 Time: 0.04636
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:44:21] [V] [TRT] Tactic: 2986078304285316765 Time: 0.095144
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:21] [V] [TRT] Tactic: 3362537467505018070 Time: 0.084772
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:21] [V] [TRT] Tactic: 3513075359009385578 Time: 0.167912
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:44:21] [V] [TRT] Tactic: 3573559043797674382 Time: 0.046712
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:44:21] [V] [TRT] Tactic: 3591970081995419777 Time: 0.024672
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:21] [V] [TRT] Tactic: 3704534001553878387 Time: 0.089524
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:21] [V] [TRT] Tactic: 4278315135102886928 Time: 0.046616
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:44:21] [V] [TRT] Tactic: 4503233883285355107 Time: 0.035072
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:21] [V] [TRT] Tactic: 4802447371470387646 Time: 0.100872
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5059676457552313631 Time: 0.163508
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5368829646735632944 Time: 0.029104
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5398999388616959893 Time: 0.08988
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5746691132547383910 Time: 0.046936
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5770170567977052602 Time: 0.101888
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:44:21] [V] [TRT] Tactic: 5953552212833506549 Time: 0.085052
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6034364043891107501 Time: 0.045824
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6074229447555668232 Time: 0.027776
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6154447660803990543 Time: 0.044212
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6325769668000961702 Time: 0.083188
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6350273239113254096 Time: 0.020756
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6377497238381488891 Time: 0.084908
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6446388116965632819 Time: 0.047508
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6468794451065529747 Time: 0.046256
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6642277870194067185 Time: 0.169884
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6859477213531075460 Time: 0.027904
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6972489290272968208 Time: 0.083328
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:44:21] [V] [TRT] Tactic: 6979044990896381511 Time: 0.159744
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:21] [V] [TRT] Tactic: 7216571380637776659 Time: 0.106112
[05/21/2021-07:44:21] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:22] [V] [TRT] Tactic: 7609923741161019135 Time: 0.046464
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:44:22] [V] [TRT] Tactic: 7705739241028240201 Time: 0.029568
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:44:22] [V] [TRT] Tactic: 8072087735545283117 Time: 0.166656
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:22] [V] [TRT] Tactic: 8101703987960976805 Time: 0.029488
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:22] [V] [TRT] Tactic: 8170606396342855895 Time: 0.046572
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:22] [V] [TRT] Tactic: 8839784824303350101 Time: 0.107392
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:44:22] [V] [TRT] Tactic: -9217371357561775773 Time: 0.028288
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:22] [V] [TRT] Tactic: -9009272790678027912 Time: 0.093856
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:44:22] [V] [TRT] Tactic: -8985224497679592364 Time: 0.032884
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:44:22] [V] [TRT] Tactic: -8949544755481315679 Time: 0.04608
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:44:22] [V] [TRT] Tactic: -8759929675070720385 Time: 0.086444
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:22] [V] [TRT] Tactic: -8604374562669615024 Time: 0.02834
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6902925267326201166 Time: 0.021676
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6840588038605932325 Time: 0.046664
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6799856376604253964 Time: 0.162396
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6625722781282978136 Time: 0.046376
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6525498856028268801 Time: 0.087168
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6356316196810535311 Time: 0.02972
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6324345858751792783 Time: 0.046936
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6262400699544994312 Time: 0.160712
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6257787336162086472 Time: 0.097664
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:22] [V] [TRT] Tactic: -6063766379489217211 Time: 0.045716
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5777580938094193096 Time: 0.04856
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5657273398217409378 Time: 0.166656
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5530886555766748586 Time: 0.092672
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5422685219138380548 Time: 0.045824
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5161596964442251102 Time: 0.046208
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:22] [V] [TRT] Tactic: -5127240325355316006 Time: 0.045824
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4825567853927730435 Time: 0.04608
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4796511246675321840 Time: 0.04704
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4706569565442112734 Time: 0.029728
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4566599693570369588 Time: 0.082944
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4409144516525410768 Time: 0.084088
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4379519430184503304 Time: 0.045184
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4152066959007262150 Time: 0.166772
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:22] [V] [TRT] Tactic: -4021926646879732549 Time: 0.04608
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:22] [V] [TRT] Tactic: -3987638434926559037 Time: 0.046952
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:22] [V] [TRT] Tactic: -3905653247016903130 Time: 0.09206
[05/21/2021-07:44:22] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3903974568488493144 Time: 0.052816
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3895429239811098010 Time: 0.046208
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3864869056275745423 Time: 0.095148
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3601464762214218301 Time: 0.02752
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3412636942650049698 Time: 0.093056
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3338665856053412950 Time: 0.085268
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:23] [V] [TRT] Tactic: -3058330359340425555 Time: 0.045164
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2816084650627734155 Time: 0.09718
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2662892962457732243 Time: 0.046088
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2559894581585337900 Time: 0.165376
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2530740716768816092 Time: 0.08196
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2332828394978346992 Time: 0.08566
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2241736083352441442 Time: 0.116096
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:44:23] [V] [TRT] Tactic: -2161909437867201546 Time: 0.026008
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:23] [V] [TRT] Tactic: -1985778916402815946 Time: 0.100224
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:44:23] [V] [TRT] Tactic: -1500496213132463076 Time: 0.047744
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:23] [V] [TRT] Tactic: -1099247066487349374 Time: 0.027852
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:44:23] [V] [TRT] Tactic: -910286698936744682 Time: 0.024576
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:44:23] [V] [TRT] Tactic: -606726295133751039 Time: 0.048296
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 6350273239113254096 Time: 0.020756
[05/21/2021-07:44:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6350273239113254096
[05/21/2021-07:44:23] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,448,32) -> Half(1568,1:16,224,32) ***************
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CudnnConvolution)
[05/21/2021-07:44:23] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv2 + stage4_unit1_relu3 (CaskConvolution)
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1301213148470244380 Time: 0.04416
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:44:23] [V] [TRT] Tactic: 2140378925901736289 Time: 0.041344
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:44:23] [V] [TRT] Tactic: 7019285522757193163 Time: 0.057344
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:44:23] [V] [TRT] Tactic: 7616509406849244401 Time: 0.042408
[05/21/2021-07:44:23] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:44:23] [V] [TRT] Tactic: -6575010824547653277 Time: 0.028288
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.028288
[05/21/2021-07:44:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1002 Time: 0.01064
[05/21/2021-07:44:23] [V] [TRT] Tactic: 0 Time: 0.004408
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004408
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1002 Time: 0.010684
[05/21/2021-07:44:23] [V] [TRT] Tactic: 0 Time: 0.004272
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004272
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1002 Time: 0.011544
[05/21/2021-07:44:23] [V] [TRT] Tactic: 0 Time: 0.003968
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003968
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:23] [V] [TRT] Tactic: 0 Time: 0.003584
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 0 Time: 0.003584
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:23] [V] [TRT] Tactic: 1002 Time: 0.006616
[05/21/2021-07:44:23] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:23] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:23] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,49,7,1) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.0066
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.01024
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004212
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004212
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004084
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004084
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006832
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1,3584,512) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.01128
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007208
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006328
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.00408
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00408
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.0042
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0042
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.005168
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004172
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004172
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Float(6272,1:4,896,128) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.005248
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.012188
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.003748
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003748
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007552
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004332
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004332
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.008984
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.003376
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003376
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.00832
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(25088,49,7,1) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.00832
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.00442
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00442
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.003416
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003416
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006648
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007468
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004816
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004816
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.010752
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.003972
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.003972
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007252
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,49:2,7,1) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007336
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.00722
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004552
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004552
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.005632
[05/21/2021-07:44:24] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:24] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:24] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.003968
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.003968
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(3136,1:8,448,64) -> Half(1568,1:16,224,32) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(25088,49,7,1) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.00718
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004304
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004304
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(25088,1,3584,512) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.006128
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Float(6272,1:4,896,128) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.006304
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(25088,49,7,1) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.00818
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004192
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004192
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(12544,49:2,7,1) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.007
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.004256
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.004256
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: reformat: Half(1568,1:16,224,32) -> Half(3136,1:8,448,64) (Reformat)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:44:25] [V] [TRT] Tactic: 0 Time: 0.00428
[05/21/2021-07:44:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00428
[05/21/2021-07:44:25] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:25] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:44:25] [V] [TRT] Tactic: 589823 Time: 0.109836
[05/21/2021-07:44:25] [V] [TRT] Tactic: 655359 Time: 0.07058
[05/21/2021-07:44:25] [V] [TRT] Tactic: 786431 Time: 0.041
[05/21/2021-07:44:25] [V] [TRT] Tactic: 851967 Time: 0.036224
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1179647 Time: 0.024116
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1310719 Time: 0.071344
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1376255 Time: 0.111404
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1441791 Time: 0.03538
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1507327 Time: 0.040988
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1638399 Time: 0.0256
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1835007 Time: 0.034688
[05/21/2021-07:44:25] [V] [TRT] Tactic: 1900543 Time: 0.112896
[05/21/2021-07:44:25] [V] [TRT] Tactic: 2097151 Time: 0.018856
[05/21/2021-07:44:25] [V] [TRT] Tactic: 2162687 Time: 0.111872
[05/21/2021-07:44:25] [V] [TRT] Tactic: 2293759 Time: 0.105468
[05/21/2021-07:44:25] [V] [TRT] Tactic: 2359295 Time: 0.062848
[05/21/2021-07:44:25] [V] [TRT] Tactic: 2686975 Time: 0.107576
[05/21/2021-07:44:25] [V] [TRT] Tactic: 3080191 Time: 0.057216
[05/21/2021-07:44:25] [V] [TRT] Tactic: 3342335 Time: 0.041984
[05/21/2021-07:44:25] [V] [TRT] Tactic: 3407871 Time: 0.038472
[05/21/2021-07:44:26] [V] [TRT] Tactic: 3538943 Time: 0.03008
[05/21/2021-07:44:26] [V] [TRT] Tactic: 3670015 Time: 0.208128
[05/21/2021-07:44:26] [V] [TRT] Tactic: 3932159 Time: 0.09856
[05/21/2021-07:44:26] [V] [TRT] Tactic: 3997695 Time: 0.028704
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4063231 Time: 0.034932
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4194303 Time: 0.042388
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4259839 Time: 0.01998
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4325375 Time: 0.036096
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4521983 Time: 0.069652
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4587519 Time: 0.02242
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4653055 Time: 0.020472
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4915199 Time: 0.023164
[05/21/2021-07:44:26] [V] [TRT] Tactic: 4980735 Time: 0.060556
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5177343 Time: 0.024264
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5242879 Time: 0.056064
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5373951 Time: 0.024656
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5439487 Time: 0.039608
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5570559 Time: 0.060456
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5636095 Time: 0.034968
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5701631 Time: 0.10442
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5767167 Time: 0.038912
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5832703 Time: 0.039056
[05/21/2021-07:44:26] [V] [TRT] Tactic: 5898239 Time: 0.018176
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6029311 Time: 0.085532
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6225919 Time: 0.035328
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6291455 Time: 0.023808
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6422527 Time: 0.05632
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6750207 Time: 0.024596
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6815743 Time: 0.05994
[05/21/2021-07:44:26] [V] [TRT] Tactic: 6946815 Time: 0.039168
[05/21/2021-07:44:26] [V] [TRT] Tactic: 7012351 Time: 0.018816
[05/21/2021-07:44:26] [V] [TRT] Tactic: 7077887 Time: 0.027836
[05/21/2021-07:44:26] [V] [TRT] Tactic: 7143423 Time: 0.037904
[05/21/2021-07:44:26] [V] [TRT] Tactic: 7208959 Time: 0.03968
[05/21/2021-07:44:26] [V] [TRT] Tactic: 7340031 Time: 0.019476
[05/21/2021-07:44:27] [V] [TRT] Tactic: 7405567 Time: 0.033944
[05/21/2021-07:44:27] [V] [TRT] Tactic: 7536639 Time: 0.097416
[05/21/2021-07:44:27] [V] [TRT] Tactic: 7602175 Time: 0.038016
[05/21/2021-07:44:27] [V] [TRT] Tactic: 7733247 Time: 0.038016
[05/21/2021-07:44:27] [V] [TRT] Tactic: 7798783 Time: 0.040568
[05/21/2021-07:44:27] [V] [TRT] Tactic: 8191999 Time: 0.03546
[05/21/2021-07:44:27] [V] [TRT] Tactic: 8257535 Time: 0.026752
[05/21/2021-07:44:27] [V] [TRT] Tactic: 8323071 Time: 0.038444
[05/21/2021-07:44:27] [V] [TRT] Tactic: 8650751 Time: 0.0288
[05/21/2021-07:44:27] [V] [TRT] Tactic: 8716287 Time: 0.02688
[05/21/2021-07:44:27] [V] [TRT] Tactic: 9109503 Time: 0.01838
[05/21/2021-07:44:27] [V] [TRT] Tactic: 9568255 Time: 0.024344
[05/21/2021-07:44:27] [V] [TRT] Tactic: 9895935 Time: 0.042512
[05/21/2021-07:44:27] [V] [TRT] Tactic: 10223615 Time: 0.10752
[05/21/2021-07:44:27] [V] [TRT] Tactic: 10354687 Time: 0.026
[05/21/2021-07:44:27] [V] [TRT] Tactic: 10551295 Time: 0.062208
[05/21/2021-07:44:27] [V] [TRT] Tactic: 10747903 Time: 0.036352
[05/21/2021-07:44:27] [V] [TRT] Tactic: 10944511 Time: 0.05952
[05/21/2021-07:44:27] [V] [TRT] Fastest Tactic: 5898239 Time: 0.018176
[05/21/2021-07:44:27] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:27] [V] [TRT] Tactic: 0 Time: 0.039224
[05/21/2021-07:44:27] [V] [TRT] Tactic: 1 Time: 0.02768
[05/21/2021-07:44:27] [V] [TRT] Tactic: 2 Time: 0.084388
[05/21/2021-07:44:27] [V] [TRT] Tactic: 4 Time: 3.59634
[05/21/2021-07:44:27] [V] [TRT] Tactic: 5 Time: 0.673856
[05/21/2021-07:44:27] [V] [TRT] Tactic: 56 Time: 0.039736
[05/21/2021-07:44:27] [V] [TRT] Tactic: 57 Time: 0.033536
[05/21/2021-07:44:27] [V] [TRT] Tactic: 58 Time: 0.133896
[05/21/2021-07:44:27] [V] [TRT] Tactic: 60 Time: 3.8775
[05/21/2021-07:44:27] [V] [TRT] Tactic: 61 Time: 0.699216
[05/21/2021-07:44:27] [V] [TRT] Tactic: 112 Time: 0.039432
[05/21/2021-07:44:27] [V] [TRT] Tactic: 113 Time: 0.033068
[05/21/2021-07:44:27] [V] [TRT] Tactic: 114 Time: 0.133
[05/21/2021-07:44:27] [V] [TRT] Tactic: 116 Time: 3.86648
[05/21/2021-07:44:27] [V] [TRT] Tactic: 117 Time: 0.697808
[05/21/2021-07:44:27] [V] [TRT] Fastest Tactic: 1 Time: 0.02768
[05/21/2021-07:44:27] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:27] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:27] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:27] [V] [TRT] Tactic: 4549827808004681195 Time: 0.052152
[05/21/2021-07:44:27] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:27] [V] [TRT] Tactic: 5779835512569528575 Time: 0.064096
[05/21/2021-07:44:27] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:44:27] [V] [TRT] Tactic: 9151672657204310840 Time: 0.075392
[05/21/2021-07:44:27] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:44:27] [V] [TRT] Tactic: -7491730084094677098 Time: 0.060076
[05/21/2021-07:44:27] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:44:28] [V] [TRT] Tactic: -6622064180404051845 Time: 0.052832
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:28] [V] [TRT] Tactic: -6313876406580483184 Time: 0.062464
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:44:28] [V] [TRT] Tactic: -6273689210331812572 Time: 0.063384
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:44:28] [V] [TRT] Tactic: -4337126844824617177 Time: 0.049536
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:28] [V] [TRT] Tactic: -1123676555321336786 Time: 0.063368
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:28] [V] [TRT] Tactic: -701551393537224327 Time: 0.054704
[05/21/2021-07:44:28] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.049536
[05/21/2021-07:44:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5898239
[05/21/2021-07:44:28] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:28] [V] [TRT] Tactic: 1663866669559596164 Time: 0.065024
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:28] [V] [TRT] Tactic: 2860655430572478466 Time: 0.039296
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4474630279712975759 Time: 0.024624
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024448
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4696204239951173149 Time: 0.03764
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:28] [V] [TRT] Tactic: 5778138195697110003 Time: 0.06144
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:28] [V] [TRT] Tactic: 8918020581761223752 Time: 0.061612
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:28] [V] [TRT] Tactic: -5905193483742532701 Time: 0.035492
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:28] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023868
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:28] [V] [TRT] Tactic: -2809379259463049391 Time: 0.062384
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:28] [V] [TRT] Tactic: -1985235291706575900 Time: 0.060692
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:28] [V] [TRT] Tactic: -504296718212024303 Time: 0.061416
[05/21/2021-07:44:28] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023868
[05/21/2021-07:44:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:28] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:28] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:28] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:44:28] [V] [TRT] Tactic: 1373022415249282411 Time: 0.048512
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:28] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06144
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:28] [V] [TRT] Tactic: 2860655430572478466 Time: 0.038048
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023552
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4479823862704990365 Time: 0.024464
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:28] [V] [TRT] Tactic: 4696204239951173149 Time: 0.039296
[05/21/2021-07:44:28] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:29] [V] [TRT] Tactic: 5778138195697110003 Time: 0.062976
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:29] [V] [TRT] Tactic: 8918020581761223752 Time: 0.060904
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:44:29] [V] [TRT] Tactic: -7067026478815706014 Time: 0.047744
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:29] [V] [TRT] Tactic: -5905193483742532701 Time: 0.034952
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:29] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023872
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:29] [V] [TRT] Tactic: -2809379259463049391 Time: 0.062264
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:29] [V] [TRT] Tactic: -1985235291706575900 Time: 0.058516
[05/21/2021-07:44:29] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:29] [V] [TRT] Tactic: -504296718212024303 Time: 0.059392
[05/21/2021-07:44:29] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 0.023552
[05/21/2021-07:44:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759
[05/21/2021-07:44:29] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:44:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:29] [V] [TRT] Tactic: 0 Time: 0.031104
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1 Time: 0.04224
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2 Time: 0.088964
[05/21/2021-07:44:29] [V] [TRT] Tactic: 4 Time: 3.8253
[05/21/2021-07:44:29] [V] [TRT] Tactic: 5 Time: 0.660468
[05/21/2021-07:44:29] [V] [TRT] Tactic: 56 Time: 0.030996
[05/21/2021-07:44:29] [V] [TRT] Tactic: 58 Time: 0.089856
[05/21/2021-07:44:29] [V] [TRT] Tactic: 60 Time: 3.8228
[05/21/2021-07:44:29] [V] [TRT] Tactic: 61 Time: 0.659984
[05/21/2021-07:44:29] [V] [TRT] Fastest Tactic: 56 Time: 0.030996
[05/21/2021-07:44:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:44:29] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:44:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:29] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:44:29] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (FusedConvActConvolution)
[05/21/2021-07:44:29] [V] [TRT] Tactic: 589823 Time: 0.060036
[05/21/2021-07:44:29] [V] [TRT] Tactic: 655359 Time: 0.043648
[05/21/2021-07:44:29] [V] [TRT] Tactic: 786431 Time: 0.020612
[05/21/2021-07:44:29] [V] [TRT] Tactic: 851967 Time: 0.017284
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1179647 Time: 0.013444
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1310719 Time: 0.031744
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1376255 Time: 0.044208
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1441791 Time: 0.017408
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1507327 Time: 0.026752
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1638399 Time: 0.017408
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1835007 Time: 0.019508
[05/21/2021-07:44:29] [V] [TRT] Tactic: 1900543 Time: 0.046632
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2097151 Time: 0.012644
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2162687 Time: 0.046612
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2293759 Time: 0.040668
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2359295 Time: 0.027008
[05/21/2021-07:44:29] [V] [TRT] Tactic: 2686975 Time: 0.041896
[05/21/2021-07:44:29] [V] [TRT] Tactic: 3080191 Time: 0.022912
[05/21/2021-07:44:29] [V] [TRT] Tactic: 3342335 Time: 0.025984
[05/21/2021-07:44:29] [V] [TRT] Tactic: 3407871 Time: 0.022712
[05/21/2021-07:44:29] [V] [TRT] Tactic: 3538943 Time: 0.01536
[05/21/2021-07:44:29] [V] [TRT] Tactic: 3670015 Time: 0.080896
[05/21/2021-07:44:30] [V] [TRT] Tactic: 3932159 Time: 0.03584
[05/21/2021-07:44:30] [V] [TRT] Tactic: 3997695 Time: 0.018816
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4063231 Time: 0.017076
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4194303 Time: 0.017936
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4259839 Time: 0.012672
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4325375 Time: 0.017036
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4521983 Time: 0.041984
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4587519 Time: 0.015252
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4653055 Time: 0.016664
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4915199 Time: 0.013452
[05/21/2021-07:44:30] [V] [TRT] Tactic: 4980735 Time: 0.023936
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5177343 Time: 0.013464
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5242879 Time: 0.021524
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5373951 Time: 0.013824
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5439487 Time: 0.017268
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5570559 Time: 0.024676
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5636095 Time: 0.017664
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5701631 Time: 0.040064
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5767167 Time: 0.023468
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5832703 Time: 0.0245
[05/21/2021-07:44:30] [V] [TRT] Tactic: 5898239 Time: 0.013568
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6029311 Time: 0.037668
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6225919 Time: 0.015744
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6291455 Time: 0.01384
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6422527 Time: 0.022272
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6750207 Time: 0.014464
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6815743 Time: 0.023532
[05/21/2021-07:44:30] [V] [TRT] Tactic: 6946815 Time: 0.017956
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7012351 Time: 0.012288
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7077887 Time: 0.015616
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7143423 Time: 0.02294
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7208959 Time: 0.025044
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7340031 Time: 0.013976
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7405567 Time: 0.016284
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7536639 Time: 0.034176
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7602175 Time: 0.018204
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7733247 Time: 0.017408
[05/21/2021-07:44:30] [V] [TRT] Tactic: 7798783 Time: 0.020356
[05/21/2021-07:44:30] [V] [TRT] Tactic: 8191999 Time: 0.01664
[05/21/2021-07:44:30] [V] [TRT] Tactic: 8257535 Time: 0.013824
[05/21/2021-07:44:30] [V] [TRT] Tactic: 8323071 Time: 0.017408
[05/21/2021-07:44:30] [V] [TRT] Tactic: 8650751 Time: 0.01792
[05/21/2021-07:44:30] [V] [TRT] Tactic: 8716287 Time: 0.016256
[05/21/2021-07:44:30] [V] [TRT] Tactic: 9109503 Time: 0.012288
[05/21/2021-07:44:31] [V] [TRT] Tactic: 9568255 Time: 0.013732
[05/21/2021-07:44:31] [V] [TRT] Tactic: 9895935 Time: 0.01794
[05/21/2021-07:44:31] [V] [TRT] Tactic: 10223615 Time: 0.041936
[05/21/2021-07:44:31] [V] [TRT] Tactic: 10354687 Time: 0.013464
[05/21/2021-07:44:31] [V] [TRT] Tactic: 10551295 Time: 0.02496
[05/21/2021-07:44:31] [V] [TRT] Tactic: 10747903 Time: 0.016388
[05/21/2021-07:44:31] [V] [TRT] Tactic: 10944511 Time: 0.023936
[05/21/2021-07:44:31] [V] [TRT] Fastest Tactic: 7012351 Time: 0.012288
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2195670545862694453 Time: 0.029952
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:31] [V] [TRT] Tactic: 3891805945559659536 Time: 0.041388
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:44:31] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0256
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:31] [V] [TRT] Tactic: 5548126322150286555 Time: 0.029952
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:31] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0288
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:44:31] [V] [TRT] Tactic: 7392644644614664811 Time: 0.027812
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:44:31] [V] [TRT] Tactic: -4884039206922900293 Time: 0.041732
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:31] [V] [TRT] Tactic: -4374269919094467161 Time: 0.028852
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:31] [V] [TRT] Tactic: -1546027692247304867 Time: 0.042344
[05/21/2021-07:44:31] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.0256
[05/21/2021-07:44:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[05/21/2021-07:44:31] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(100352,49,7,1) ***************
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:31] [V] [TRT] Tactic: 0 Time: 0.587808
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1 Time: 0.050176
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2 Time: 0.06962
[05/21/2021-07:44:31] [V] [TRT] Tactic: 56 Time: 0.587008
[05/21/2021-07:44:31] [V] [TRT] Tactic: 58 Time: 0.078336
[05/21/2021-07:44:31] [V] [TRT] Fastest Tactic: 1 Time: 0.050176
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:31] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:31] [V] [TRT] Tactic: 254850674756030979 Time: 0.024904
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1156328698016730421 Time: 0.016896
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017076
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011408
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011228
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011268
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:31] [V] [TRT] Tactic: 1899296423087490472 Time: 0.00904
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2238656696610018305 Time: 0.010532
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2541579301352125276 Time: 0.01494
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2559328254295148085 Time: 0.02386
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2657157263811141609 Time: 0.008484
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:31] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011296
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:44:31] [V] [TRT] Tactic: 3071479995783211391 Time: 0.008268
[05/21/2021-07:44:31] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:44:31] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011392
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:32] [V] [TRT] Tactic: 3362537467505018070 Time: 0.015536
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:32] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0256
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:32] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016128
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:44:32] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00824
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4278315135102886928 Time: 0.01024
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4370476717970497892 Time: 0.01024
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4480294673430783793 Time: 0.01104
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4491683531415781597 Time: 0.024972
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4528997467275241200 Time: 0.015872
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025276
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4595173549602041350 Time: 0.025388
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4802447371470387646 Time: 0.01682
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:44:32] [V] [TRT] Tactic: 4993757826442493905 Time: 0.010584
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:32] [V] [TRT] Tactic: 5059676457552313631 Time: 0.024064
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:44:32] [V] [TRT] Tactic: 5205510332404400949 Time: 0.014336
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:44:32] [V] [TRT] Tactic: 5346855796032465921 Time: 0.017024
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:32] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016392
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:32] [V] [TRT] Tactic: 6034364043891107501 Time: 0.010552
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:32] [V] [TRT] Tactic: 6377497238381488891 Time: 0.015744
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:32] [V] [TRT] Tactic: 6468794451065529747 Time: 0.011652
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:44:32] [V] [TRT] Tactic: 6697277555581639516 Time: 0.010644
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:32] [V] [TRT] Tactic: 6859477213531075460 Time: 0.008576
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:32] [V] [TRT] Tactic: 7216571380637776659 Time: 0.018088
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:32] [V] [TRT] Tactic: 7609923741161019135 Time: 0.01088
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:32] [V] [TRT] Tactic: 8101703987960976805 Time: 0.008872
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:32] [V] [TRT] Tactic: 8170606396342855895 Time: 0.011136
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:44:32] [V] [TRT] Tactic: 8764780417487154889 Time: 0.015744
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:44:32] [V] [TRT] Tactic: 8823554289762712606 Time: 0.010944
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:32] [V] [TRT] Tactic: 8839784824303350101 Time: 0.016916
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:44:32] [V] [TRT] Tactic: -9203179519031456182 Time: 0.008932
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:32] [V] [TRT] Tactic: -9009272790678027912 Time: 0.017536
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:32] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009084
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:44:32] [V] [TRT] Tactic: -8280443484414412687 Time: 0.024604
[05/21/2021-07:44:32] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:44:33] [V] [TRT] Tactic: -8205952393017864204 Time: 0.02354
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:44:33] [V] [TRT] Tactic: -8131857373260504832 Time: 0.01024
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:44:33] [V] [TRT] Tactic: -7410012245391920273 Time: 0.008552
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:44:33] [V] [TRT] Tactic: -7099920365135295801 Time: 0.009576
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:44:33] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:44:33] [V] [TRT] Tactic: -6768327495007644783 Time: 0.015952
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:33] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009252
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:33] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011136
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:33] [V] [TRT] Tactic: -5530886555766748586 Time: 0.015488
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:44:33] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00818
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:33] [V] [TRT] Tactic: -5161596964442251102 Time: 0.01152
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:33] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010376
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00834
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4796511246675321840 Time: 0.01158
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00896
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4379519430184503304 Time: 0.01088
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4293222705763522367 Time: 0.008576
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4152066959007262150 Time: 0.024576
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:33] [V] [TRT] Tactic: -4021926646879732549 Time: 0.010248
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:33] [V] [TRT] Tactic: -3987638434926559037 Time: 0.011264
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:33] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0165
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:44:33] [V] [TRT] Tactic: -3903342530518878192 Time: 0.016
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:33] [V] [TRT] Tactic: -3864869056275745423 Time: 0.016256
[05/21/2021-07:44:33] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:34] [V] [TRT] Tactic: -3601464762214218301 Time: 0.008236
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:34] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011316
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:44:34] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016184
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:44:34] [V] [TRT] Tactic: -2602982885923184927 Time: 0.015416
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:44:34] [V] [TRT] Tactic: -2353603993968373338 Time: 0.01664
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:44:34] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011512
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:44:34] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010112
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1985778916402815946 Time: 0.016112
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00794
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011392
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1562548049711204899 Time: 0.016312
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1242202084391243207 Time: 0.01088
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1099247066487349374 Time: 0.008616
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:44:34] [V] [TRT] Tactic: -1038291877007553549 Time: 0.01024
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:44:34] [V] [TRT] Tactic: -406984317033388136 Time: 0.01572
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:44:34] [V] [TRT] Tactic: -331499326992534460 Time: 0.010392
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:44:34] [V] [TRT] Tactic: -206523504474952360 Time: 0.016352
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.00794
[05/21/2021-07:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567
[05/21/2021-07:44:34] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CudnnConvolution)
[05/21/2021-07:44:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CublasConvolution)
[05/21/2021-07:44:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: stage4_unit1_conv3 (CaskConvolution)
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:44:34] [V] [TRT] Tactic: 162720039126739803 Time: 0.008176
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:44:34] [V] [TRT] Tactic: 382577144988222004 Time: 0.010792
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:44:34] [V] [TRT] Tactic: 2334614616543277495 Time: 0.011144
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:44:34] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008428
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:44:34] [V] [TRT] Tactic: 6466136707377588846 Time: 0.007424
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:44:34] [V] [TRT] Tactic: 6958123061428231366 Time: 0.008192
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:44:34] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008192
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:44:34] [V] [TRT] Tactic: -7023377647582255231 Time: 0.008064
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:44:34] [V] [TRT] Tactic: -6148657501329441429 Time: 0.00832
[05/21/2021-07:44:34] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:44:34] [V] [TRT] Tactic: -3396930063803107917 Time: 0.0072
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: -3396930063803107917 Time: 0.0072
[05/21/2021-07:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3396930063803107917
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.009472
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.011288
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.005532
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.005532
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.030004
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.007828
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:34] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:44:34] [V] [TRT] Tactic: 0 Time: 0.005652
[05/21/2021-07:44:34] [V] [TRT] Fastest Tactic: 0 Time: 0.005652
[05/21/2021-07:44:34] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.01128
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.00734
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004424
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004424
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007308
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004916
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004916
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006452
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.00474
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00474
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006244
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.0045
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0045
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.01128
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007992
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004544
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004544
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006148
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006824
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.029952
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.005248
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.005552
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005552
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.009276
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.008504
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004124
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004124
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.008224
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.005004
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.005004
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.010804
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004072
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004072
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.007384
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004116
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004116
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006552
[05/21/2021-07:44:35] [V] [TRT] Tactic: 0 Time: 0.004744
[05/21/2021-07:44:35] [V] [TRT] Fastest Tactic: 0 Time: 0.004744
[05/21/2021-07:44:35] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:35] [V] [TRT] Tactic: 1002 Time: 0.006512
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004248
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004248
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004076
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004076
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.007056
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.007452
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.005076
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.005076
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.006556
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004824
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004824
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.006452
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004632
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004632
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.008328
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.007276
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1002 Time: 0.006164
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.004376
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004376
[05/21/2021-07:44:36] [V] [TRT] *************** Autotuning format combination: Float(200704,196,14,1), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudaDepthwiseConvolution)
[05/21/2021-07:44:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (FusedConvActConvolution)
[05/21/2021-07:44:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:36] [V] [TRT] Tactic: 0 Time: 0.077056
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1 Time: 0.063104
[05/21/2021-07:44:36] [V] [TRT] Tactic: 2 Time: 0.173312
[05/21/2021-07:44:36] [V] [TRT] Tactic: 56 Time: 0.076032
[05/21/2021-07:44:36] [V] [TRT] Tactic: 57 Time: 0.063004
[05/21/2021-07:44:36] [V] [TRT] Tactic: 58 Time: 0.173596
[05/21/2021-07:44:36] [V] [TRT] Tactic: 112 Time: 0.076328
[05/21/2021-07:44:36] [V] [TRT] Tactic: 113 Time: 0.06272
[05/21/2021-07:44:36] [V] [TRT] Tactic: 114 Time: 0.172976
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: 113 Time: 0.06272
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:36] [V] [TRT] Tactic: 4549827808004681195 Time: 0.096568
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:36] [V] [TRT] Tactic: 5779835512569528575 Time: 0.118836
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:44:36] [V] [TRT] Tactic: 9151672657204310840 Time: 0.109732
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:44:36] [V] [TRT] Tactic: -7491730084094677098 Time: 0.158208
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:36] [V] [TRT] Tactic: -6313876406580483184 Time: 0.161024
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:44:36] [V] [TRT] Tactic: -6273689210331812572 Time: 0.116268
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:44:36] [V] [TRT] Tactic: -4337126844824617177 Time: 0.090368
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:36] [V] [TRT] Tactic: -1123676555321336786 Time: 0.116756
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:36] [V] [TRT] Tactic: -701551393537224327 Time: 0.102388
[05/21/2021-07:44:36] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.090368
[05/21/2021-07:44:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 113
[05/21/2021-07:44:36] [V] [TRT] *************** Autotuning format combination: Float(200704,1,14336,1024), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:36] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:36] [V] [TRT] Tactic: 1663866669559596164 Time: 0.119424
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:36] [V] [TRT] Tactic: 2860655430572478466 Time: 0.072832
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:36] [V] [TRT] Tactic: 4474630279712975759 Time: 0.043044
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:36] [V] [TRT] Tactic: 4479823862704990365 Time: 0.042664
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:36] [V] [TRT] Tactic: 4696204239951173149 Time: 0.071552
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:36] [V] [TRT] Tactic: 5778138195697110003 Time: 0.120216
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:36] [V] [TRT] Tactic: 8918020581761223752 Time: 0.116152
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:36] [V] [TRT] Tactic: -5905193483742532701 Time: 0.064368
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:36] [V] [TRT] Tactic: -4035591156787122265 Time: 0.041036
[05/21/2021-07:44:36] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:37] [V] [TRT] Tactic: -2809379259463049391 Time: 0.120052
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:37] [V] [TRT] Tactic: -1985235291706575900 Time: 0.11696
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:37] [V] [TRT] Tactic: -504296718212024303 Time: 0.118572
[05/21/2021-07:44:37] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.041036
[05/21/2021-07:44:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:37] [V] [TRT] *************** Autotuning format combination: Float(50176,1:4,3584,256), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:44:37] [V] [TRT] Tactic: 1373022415249282411 Time: 0.08064
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:37] [V] [TRT] Tactic: 1663866669559596164 Time: 0.119528
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:37] [V] [TRT] Tactic: 2860655430572478466 Time: 0.073004
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:37] [V] [TRT] Tactic: 4474630279712975759 Time: 0.043136
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:37] [V] [TRT] Tactic: 4479823862704990365 Time: 0.042548
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:37] [V] [TRT] Tactic: 4696204239951173149 Time: 0.070872
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:37] [V] [TRT] Tactic: 5778138195697110003 Time: 0.119968
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:44:37] [V] [TRT] Tactic: 7342025736444949634 Time: 0.080896
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:37] [V] [TRT] Tactic: 8918020581761223752 Time: 0.1182
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:37] [V] [TRT] Tactic: -5905193483742532701 Time: 0.06464
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:44:37] [V] [TRT] Tactic: -5457304872213719461 Time: 0.081676
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:37] [V] [TRT] Tactic: -4035591156787122265 Time: 0.041728
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:37] [V] [TRT] Tactic: -2809379259463049391 Time: 0.118756
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:37] [V] [TRT] Tactic: -1985235291706575900 Time: 0.11604
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:37] [V] [TRT] Tactic: -504296718212024303 Time: 0.115976
[05/21/2021-07:44:37] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.041728
[05/21/2021-07:44:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:37] [V] [TRT] *************** Autotuning format combination: Half(200704,196,14,1), Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:37] [V] [TRT] Tactic: 0 Time: 0.064528
[05/21/2021-07:44:37] [V] [TRT] Tactic: 1 Time: 0.078108
[05/21/2021-07:44:37] [V] [TRT] Tactic: 2 Time: 0.157492
[05/21/2021-07:44:37] [V] [TRT] Tactic: 56 Time: 0.104852
[05/21/2021-07:44:37] [V] [TRT] Tactic: 58 Time: 0.15736
[05/21/2021-07:44:37] [V] [TRT] Fastest Tactic: 0 Time: 0.064528
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[05/21/2021-07:44:37] [V] [TRT] *************** Autotuning format combination: Half(100352,196:2,14,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (FusedConvActConvolution)
[05/21/2021-07:44:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:37] [V] [TRT] Tactic: 2195670545862694453 Time: 0.066176
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:37] [V] [TRT] Tactic: 3891805945559659536 Time: 0.077968
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:44:37] [V] [TRT] Tactic: 4418200634486186714 Time: 0.049024
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:37] [V] [TRT] Tactic: 5548126322150286555 Time: 0.054836
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:37] [V] [TRT] Tactic: 6057304366605292508 Time: 0.048872
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:44:37] [V] [TRT] Tactic: 7392644644614664811 Time: 0.047212
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:44:37] [V] [TRT] Tactic: -4884039206922900293 Time: 0.077592
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:37] [V] [TRT] Tactic: -4374269919094467161 Time: 0.05888
[05/21/2021-07:44:37] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:37] [V] [TRT] Tactic: -1546027692247304867 Time: 0.07872
[05/21/2021-07:44:37] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.047212
[05/21/2021-07:44:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[05/21/2021-07:44:37] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:37] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:37] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:38] [V] [TRT] *************** Autotuning format combination: Half(25088,1:8,1792,128), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:44:38] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudaDepthwiseConvolution)
[05/21/2021-07:44:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:38] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:38] [V] [TRT] Tactic: 0 Time: 1.16958
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1 Time: 0.082304
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2 Time: 0.150016
[05/21/2021-07:44:38] [V] [TRT] Tactic: 56 Time: 1.16971
[05/21/2021-07:44:38] [V] [TRT] Tactic: 58 Time: 0.149632
[05/21/2021-07:44:38] [V] [TRT] Fastest Tactic: 1 Time: 0.082304
[05/21/2021-07:44:38] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:38] [V] [TRT] Tactic: 254850674756030979 Time: 0.04416
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1011057357468998345 Time: 0.025312
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1156328698016730421 Time: 0.026664
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1362727228442059924 Time: 0.026796
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1576319725282257846 Time: 0.015744
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1832046141070096030 Time: 0.017532
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1838082074606840426 Time: 0.017536
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:38] [V] [TRT] Tactic: 1899296423087490472 Time: 0.014108
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2238656696610018305 Time: 0.016616
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2428167804343994714 Time: 0.016896
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2541579301352125276 Time: 0.028388
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2559328254295148085 Time: 0.043136
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2657157263811141609 Time: 0.014088
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:38] [V] [TRT] Tactic: 2968605903460894194 Time: 0.017408
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:44:38] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010624
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:44:38] [V] [TRT] Tactic: 3359475309458902373 Time: 0.014556
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:38] [V] [TRT] Tactic: 3362537467505018070 Time: 0.024448
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:38] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0448
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:38] [V] [TRT] Tactic: 3704534001553878387 Time: 0.027368
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:38] [V] [TRT] Tactic: 4278315135102886928 Time: 0.016552
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:44:38] [V] [TRT] Tactic: 4480294673430783793 Time: 0.016244
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:44:38] [V] [TRT] Tactic: 4571819373777460444 Time: 0.044416
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:38] [V] [TRT] Tactic: 4802447371470387646 Time: 0.030236
[05/21/2021-07:44:38] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:39] [V] [TRT] Tactic: 5059676457552313631 Time: 0.043816
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:44:39] [V] [TRT] Tactic: 5205510332404400949 Time: 0.027776
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:44:39] [V] [TRT] Tactic: 5346855796032465921 Time: 0.023564
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:44:39] [V] [TRT] Tactic: 5368829646735632944 Time: 0.010232
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:39] [V] [TRT] Tactic: 5398999388616959893 Time: 0.025472
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6034364043891107501 Time: 0.014984
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6154447660803990543 Time: 0.017048
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6325769668000961702 Time: 0.026496
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6350273239113254096 Time: 0.01336
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6377497238381488891 Time: 0.025984
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6468794451065529747 Time: 0.01746
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6859477213531075460 Time: 0.013056
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:44:39] [V] [TRT] Tactic: 6979044990896381511 Time: 0.04328
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:39] [V] [TRT] Tactic: 7216571380637776659 Time: 0.033036
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:39] [V] [TRT] Tactic: 7609923741161019135 Time: 0.015344
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:44:39] [V] [TRT] Tactic: 8072087735545283117 Time: 0.041204
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:39] [V] [TRT] Tactic: 8101703987960976805 Time: 0.011988
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:39] [V] [TRT] Tactic: 8170606396342855895 Time: 0.017792
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:44:39] [V] [TRT] Tactic: 8764780417487154889 Time: 0.027648
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:39] [V] [TRT] Tactic: 8839784824303350101 Time: 0.030764
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:39] [V] [TRT] Tactic: -9009272790678027912 Time: 0.031848
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8985224497679592364 Time: 0.014892
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8759929675070720385 Time: 0.02588
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8604374562669615024 Time: 0.013332
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8280443484414412687 Time: 0.041588
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8205952393017864204 Time: 0.04094
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:44:39] [V] [TRT] Tactic: -8131857373260504832 Time: 0.014952
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:44:39] [V] [TRT] Tactic: -7410012245391920273 Time: 0.014256
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:44:39] [V] [TRT] Tactic: -7099920365135295801 Time: 0.016164
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:44:39] [V] [TRT] Tactic: -7089118800560870395 Time: 0.013188
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:44:39] [V] [TRT] Tactic: -6799856376604253964 Time: 0.04352
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:44:39] [V] [TRT] Tactic: -6525498856028268801 Time: 0.025216
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:39] [V] [TRT] Tactic: -6356316196810535311 Time: 0.01216
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:44:39] [V] [TRT] Tactic: -6324345858751792783 Time: 0.014464
[05/21/2021-07:44:39] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:39] [V] [TRT] Tactic: -6063766379489217211 Time: 0.01536
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5777580938094193096 Time: 0.016384
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5657273398217409378 Time: 0.043008
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5530886555766748586 Time: 0.028208
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5409588854490562130 Time: 0.013932
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5161596964442251102 Time: 0.017408
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:40] [V] [TRT] Tactic: -5127240325355316006 Time: 0.016384
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4950923835688973492 Time: 0.012544
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4825567853927730435 Time: 0.016472
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4796511246675321840 Time: 0.016244
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4548822885169694805 Time: 0.011512
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4379519430184503304 Time: 0.01536
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4293222705763522367 Time: 0.012928
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4152066959007262150 Time: 0.044288
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:40] [V] [TRT] Tactic: -4021926646879732549 Time: 0.016692
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3987638434926559037 Time: 0.01792
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3905653247016903130 Time: 0.028032
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3903974568488493144 Time: 0.017352
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3903342530518878192 Time: 0.028348
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3864869056275745423 Time: 0.024576
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3601464762214218301 Time: 0.011052
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3338665856053412950 Time: 0.023552
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:40] [V] [TRT] Tactic: -3058330359340425555 Time: 0.017552
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2878731503146438856 Time: 0.025776
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2662892962457732243 Time: 0.016384
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2602982885923184927 Time: 0.025896
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2530740716768816092 Time: 0.024468
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2353603993968373338 Time: 0.030012
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2332828394978346992 Time: 0.024032
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2161909437867201546 Time: 0.011368
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2032577876140256150 Time: 0.017408
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:44:40] [V] [TRT] Tactic: -2003055242756584050 Time: 0.016384
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:40] [V] [TRT] Tactic: -1985778916402815946 Time: 0.030336
[05/21/2021-07:44:40] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:44:41] [V] [TRT] Tactic: -1640527254204634147 Time: 0.017408
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:44:41] [V] [TRT] Tactic: -1562548049711204899 Time: 0.025624
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:44:41] [V] [TRT] Tactic: -1242202084391243207 Time: 0.016536
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:41] [V] [TRT] Tactic: -1099247066487349374 Time: 0.013368
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:44:41] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0168
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:44:41] [V] [TRT] Tactic: -910286698936744682 Time: 0.010228
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:44:41] [V] [TRT] Tactic: -606726295133751039 Time: 0.014336
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:44:41] [V] [TRT] Tactic: -406984317033388136 Time: 0.024784
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:44:41] [V] [TRT] Tactic: -331499326992534460 Time: 0.014428
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: -910286698936744682 Time: 0.010228
[05/21/2021-07:44:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -910286698936744682
[05/21/2021-07:44:41] [V] [TRT] *************** Autotuning format combination: Half(12544,1:16,896,64), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CudnnConvolution)
[05/21/2021-07:44:41] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: stage4_unit1_sc + _plus13 (CaskConvolution)
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1301213148470244380 Time: 0.0145
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:44:41] [V] [TRT] Tactic: 2140378925901736289 Time: 0.014084
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:44:41] [V] [TRT] Tactic: 2334614616543277495 Time: 0.016384
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:44:41] [V] [TRT] Tactic: 4126996489741716394 Time: 0.011656
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:44:41] [V] [TRT] Tactic: 7019285522757193163 Time: 0.017812
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:44:41] [V] [TRT] Tactic: 7616509406849244401 Time: 0.014208
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:44:41] [V] [TRT] Tactic: 8940522081427638481 Time: 0.01152
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:44:41] [V] [TRT] Tactic: -6575010824547653277 Time: 0.010648
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:44:41] [V] [TRT] Tactic: -6148657501329441429 Time: 0.01126
[05/21/2021-07:44:41] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:44:41] [V] [TRT] Tactic: -3396930063803107917 Time: 0.01024
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: -3396930063803107917 Time: 0.01024
[05/21/2021-07:44:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3396930063803107917
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.009344
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.005184
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005184
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.010496
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.029568
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004736
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004736
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.00768
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.006656
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004212
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004212
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.006784
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.005524
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005524
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.011264
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004608
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.007808
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004312
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004312
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.006912
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004884
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004884
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.006712
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004632
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004632
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(100352,1,14336,2048) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.006316
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.00454
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00454
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.011436
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.008108
[05/21/2021-07:44:41] [V] [TRT] Tactic: 0 Time: 0.00458
[05/21/2021-07:44:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00458
[05/21/2021-07:44:41] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:41] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007308
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.00634
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Float(25088,1:4,3584,512) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006504
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.029696
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004256
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004256
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.005096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005096
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.005124
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005124
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.008676
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.008064
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(100352,49,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.008704
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.005376
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005376
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.00832
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004244
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004244
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007596
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004876
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004876
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.005072
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005072
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.01066
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004016
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004016
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007164
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004172
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004172
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(50176,49:2,7,1) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007288
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007424
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004296
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004296
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006404
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.005084
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.005084
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.008576
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.003968
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.003968
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(12544,1:8,1792,256) -> Half(6272,1:16,896,128) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004392
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004392
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007288
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.0051
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0051
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(100352,1,14336,2048) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004532
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004532
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Float(25088,1:4,3584,512) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006432
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(100352,49,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.008192
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(50176,49:2,7,1) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.007296
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004896
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004896
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: reformat: Half(6272,1:16,896,128) -> Half(12544,1:8,1792,256) (Reformat)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004276
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004276
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004124
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004124
[05/21/2021-07:44:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:44:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[05/21/2021-07:44:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_bn1 + stage4_unit2_relu1 (Scale)
[05/21/2021-07:44:42] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:44:42] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:44:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:42] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:44:42] [V] [TRT] Tactic: 589823 Time: 0.702592
[05/21/2021-07:44:42] [V] [TRT] Tactic: 655359 Time: 0.403396
[05/21/2021-07:44:42] [V] [TRT] Tactic: 786431 Time: 0.128156
[05/21/2021-07:44:43] [V] [TRT] Tactic: 851967 Time: 0.107908
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1179647 Time: 0.065244
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1310719 Time: 0.252288
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1376255 Time: 0.425524
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1441791 Time: 0.055464
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1507327 Time: 0.140572
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1638399 Time: 0.057344
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1835007 Time: 0.140928
[05/21/2021-07:44:43] [V] [TRT] Tactic: 1900543 Time: 0.420736
[05/21/2021-07:44:43] [V] [TRT] Tactic: 2097151 Time: 0.041088
[05/21/2021-07:44:43] [V] [TRT] Tactic: 2162687 Time: 0.413312
[05/21/2021-07:44:43] [V] [TRT] Tactic: 2293759 Time: 0.403988
[05/21/2021-07:44:43] [V] [TRT] Tactic: 2359295 Time: 0.22272
[05/21/2021-07:44:43] [V] [TRT] Tactic: 2686975 Time: 0.413056
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3080191 Time: 0.19968
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3342335 Time: 0.215312
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3407871 Time: 0.20672
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3538943 Time: 0.109184
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3670015 Time: 0.518024
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3932159 Time: 0.220416
[05/21/2021-07:44:43] [V] [TRT] Tactic: 3997695 Time: 0.070416
[05/21/2021-07:44:43] [V] [TRT] Tactic: 4063231 Time: 0.109184
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4194303 Time: 0.13786
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4259839 Time: 0.04456
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4325375 Time: 0.110976
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4521983 Time: 0.405968
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4587519 Time: 0.072736
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4653055 Time: 0.052244
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4915199 Time: 0.050252
[05/21/2021-07:44:44] [V] [TRT] Tactic: 4980735 Time: 0.132632
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5177343 Time: 0.065664
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5242879 Time: 0.194688
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5373951 Time: 0.06568
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5439487 Time: 0.125824
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5570559 Time: 0.215296
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5636095 Time: 0.1088
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5701631 Time: 0.396276
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5767167 Time: 0.125992
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5832703 Time: 0.131968
[05/21/2021-07:44:44] [V] [TRT] Tactic: 5898239 Time: 0.053632
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6029311 Time: 0.256416
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6225919 Time: 0.107396
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6291455 Time: 0.065184
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6422527 Time: 0.194776
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6750207 Time: 0.063876
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6815743 Time: 0.205356
[05/21/2021-07:44:44] [V] [TRT] Tactic: 6946815 Time: 0.122868
[05/21/2021-07:44:44] [V] [TRT] Tactic: 7012351 Time: 0.030208
[05/21/2021-07:44:44] [V] [TRT] Tactic: 7077887 Time: 0.070784
[05/21/2021-07:44:44] [V] [TRT] Tactic: 7143423 Time: 0.125696
[05/21/2021-07:44:44] [V] [TRT] Tactic: 7208959 Time: 0.20586
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7340031 Time: 0.069464
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7405567 Time: 0.100608
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7536639 Time: 0.366208
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7602175 Time: 0.120496
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7733247 Time: 0.07922
[05/21/2021-07:44:45] [V] [TRT] Tactic: 7798783 Time: 0.088064
[05/21/2021-07:44:45] [V] [TRT] Tactic: 8191999 Time: 0.066712
[05/21/2021-07:44:45] [V] [TRT] Tactic: 8257535 Time: 0.051216
[05/21/2021-07:44:45] [V] [TRT] Tactic: 8323071 Time: 0.1237
[05/21/2021-07:44:45] [V] [TRT] Tactic: 8650751 Time: 0.121512
[05/21/2021-07:44:45] [V] [TRT] Tactic: 8716287 Time: 0.109224
[05/21/2021-07:44:45] [V] [TRT] Tactic: 9109503 Time: 0.04168
[05/21/2021-07:44:45] [V] [TRT] Tactic: 9568255 Time: 0.072592
[05/21/2021-07:44:45] [V] [TRT] Tactic: 9895935 Time: 0.137564
[05/21/2021-07:44:45] [V] [TRT] Tactic: 10223615 Time: 0.413196
[05/21/2021-07:44:45] [V] [TRT] Tactic: 10354687 Time: 0.054272
[05/21/2021-07:44:45] [V] [TRT] Tactic: 10551295 Time: 0.138112
[05/21/2021-07:44:45] [V] [TRT] Tactic: 10747903 Time: 0.075784
[05/21/2021-07:44:45] [V] [TRT] Tactic: 10944511 Time: 0.21156
[05/21/2021-07:44:45] [V] [TRT] Fastest Tactic: 7012351 Time: 0.030208
[05/21/2021-07:44:45] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:45] [V] [TRT] Tactic: 0 Time: 0.12416
[05/21/2021-07:44:45] [V] [TRT] Tactic: 1 Time: 0.103972
[05/21/2021-07:44:45] [V] [TRT] Tactic: 2 Time: 0.211456
[05/21/2021-07:44:45] [V] [TRT] Tactic: 4 Time: 3.86541
[05/21/2021-07:44:45] [V] [TRT] Tactic: 5 Time: 0.743104
[05/21/2021-07:44:45] [V] [TRT] Tactic: 56 Time: 0.124304
[05/21/2021-07:44:45] [V] [TRT] Tactic: 57 Time: 0.104088
[05/21/2021-07:44:45] [V] [TRT] Tactic: 58 Time: 0.2112
[05/21/2021-07:44:45] [V] [TRT] Tactic: 60 Time: 3.88106
[05/21/2021-07:44:45] [V] [TRT] Tactic: 61 Time: 0.740692
[05/21/2021-07:44:45] [V] [TRT] Tactic: 112 Time: 0.118912
[05/21/2021-07:44:45] [V] [TRT] Tactic: 113 Time: 0.074748
[05/21/2021-07:44:45] [V] [TRT] Tactic: 114 Time: 0.127172
[05/21/2021-07:44:46] [V] [TRT] Tactic: 116 Time: 3.57393
[05/21/2021-07:44:46] [V] [TRT] Tactic: 117 Time: 0.722508
[05/21/2021-07:44:46] [V] [TRT] Fastest Tactic: 113 Time: 0.074748
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4549827808004681195 Time: 0.177568
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:46] [V] [TRT] Tactic: 5779835512569528575 Time: 0.224896
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:44:46] [V] [TRT] Tactic: 9151672657204310840 Time: 0.189484
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:44:46] [V] [TRT] Tactic: -7491730084094677098 Time: 0.292572
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:44:46] [V] [TRT] Tactic: -6622064180404051845 Time: 0.178468
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:46] [V] [TRT] Tactic: -6313876406580483184 Time: 0.300588
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:44:46] [V] [TRT] Tactic: -6273689210331812572 Time: 0.221568
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:44:46] [V] [TRT] Tactic: -4337126844824617177 Time: 0.160272
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:46] [V] [TRT] Tactic: -1123676555321336786 Time: 0.22144
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:46] [V] [TRT] Tactic: -701551393537224327 Time: 0.185844
[05/21/2021-07:44:46] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.160272
[05/21/2021-07:44:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[05/21/2021-07:44:46] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(25088,1,3584,512) ***************
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:46] [V] [TRT] Tactic: 1663866669559596164 Time: 0.226816
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:46] [V] [TRT] Tactic: 2860655430572478466 Time: 0.1338
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0736
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4479823862704990365 Time: 0.07296
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4696204239951173149 Time: 0.13084
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:46] [V] [TRT] Tactic: 5778138195697110003 Time: 0.227712
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:46] [V] [TRT] Tactic: 8918020581761223752 Time: 0.218688
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:46] [V] [TRT] Tactic: -5905193483742532701 Time: 0.116352
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:46] [V] [TRT] Tactic: -4035591156787122265 Time: 0.071424
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:46] [V] [TRT] Tactic: -2809379259463049391 Time: 0.224464
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:46] [V] [TRT] Tactic: -1985235291706575900 Time: 0.213376
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:46] [V] [TRT] Tactic: -504296718212024303 Time: 0.216332
[05/21/2021-07:44:46] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.071424
[05/21/2021-07:44:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:46] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(6272,1:4,896,128) ***************
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:46] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:46] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:44:46] [V] [TRT] Tactic: 1373022415249282411 Time: 0.147064
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:44:46] [V] [TRT] Tactic: 1663866669559596164 Time: 0.225324
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:46] [V] [TRT] Tactic: 2860655430572478466 Time: 0.135204
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0736
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4479823862704990365 Time: 0.073
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:46] [V] [TRT] Tactic: 4696204239951173149 Time: 0.130544
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:46] [V] [TRT] Tactic: 5778138195697110003 Time: 0.228108
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:46] [V] [TRT] Tactic: 8918020581761223752 Time: 0.218688
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:44:46] [V] [TRT] Tactic: -7067026478815706014 Time: 0.153264
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:44:46] [V] [TRT] Tactic: -5905193483742532701 Time: 0.116096
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:44:46] [V] [TRT] Tactic: -4035591156787122265 Time: 0.07146
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:46] [V] [TRT] Tactic: -2809379259463049391 Time: 0.221192
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:44:46] [V] [TRT] Tactic: -1985235291706575900 Time: 0.21352
[05/21/2021-07:44:46] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:46] [V] [TRT] Tactic: -504296718212024303 Time: 0.216688
[05/21/2021-07:44:46] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.07146
[05/21/2021-07:44:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:44:47] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:44:47] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:47] [V] [TRT] Tactic: 0 Time: 0.176732
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1 Time: 0.10496
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2 Time: 0.149652
[05/21/2021-07:44:47] [V] [TRT] Tactic: 4 Time: 3.81484
[05/21/2021-07:44:47] [V] [TRT] Tactic: 5 Time: 0.726656
[05/21/2021-07:44:47] [V] [TRT] Tactic: 56 Time: 0.117572
[05/21/2021-07:44:47] [V] [TRT] Tactic: 58 Time: 0.149632
[05/21/2021-07:44:47] [V] [TRT] Tactic: 60 Time: 3.80516
[05/21/2021-07:44:47] [V] [TRT] Tactic: 61 Time: 0.724804
[05/21/2021-07:44:47] [V] [TRT] Fastest Tactic: 1 Time: 0.10496
[05/21/2021-07:44:47] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:47] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:44:47] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:44:47] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:47] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(12544,49:2,7,1) ***************
[05/21/2021-07:44:47] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (FusedConvActConvolution)
[05/21/2021-07:44:47] [V] [TRT] Tactic: 589823 Time: 0.220416
[05/21/2021-07:44:47] [V] [TRT] Tactic: 655359 Time: 0.15552
[05/21/2021-07:44:47] [V] [TRT] Tactic: 786431 Time: 0.05404
[05/21/2021-07:44:47] [V] [TRT] Tactic: 851967 Time: 0.043264
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1179647 Time: 0.027788
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1310719 Time: 0.105472
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1376255 Time: 0.159744
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1441791 Time: 0.031808
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1507327 Time: 0.08704
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1638399 Time: 0.033024
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1835007 Time: 0.050816
[05/21/2021-07:44:47] [V] [TRT] Tactic: 1900543 Time: 0.166272
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2097151 Time: 0.021164
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2162687 Time: 0.16532
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2293759 Time: 0.14318
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2359295 Time: 0.088592
[05/21/2021-07:44:47] [V] [TRT] Tactic: 2686975 Time: 0.146648
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3080191 Time: 0.07552
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3342335 Time: 0.084992
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3407871 Time: 0.073008
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3538943 Time: 0.039936
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3670015 Time: 0.302464
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3932159 Time: 0.123528
[05/21/2021-07:44:47] [V] [TRT] Tactic: 3997695 Time: 0.032
[05/21/2021-07:44:47] [V] [TRT] Tactic: 4063231 Time: 0.043392
[05/21/2021-07:44:47] [V] [TRT] Tactic: 4194303 Time: 0.051712
[05/21/2021-07:44:47] [V] [TRT] Tactic: 4259839 Time: 0.021548
[05/21/2021-07:44:47] [V] [TRT] Tactic: 4325375 Time: 0.039312
[05/21/2021-07:44:48] [V] [TRT] Tactic: 4521983 Time: 0.146176
[05/21/2021-07:44:48] [V] [TRT] Tactic: 4587519 Time: 0.029056
[05/21/2021-07:44:48] [V] [TRT] Tactic: 4653055 Time: 0.032128
[05/21/2021-07:44:48] [V] [TRT] Tactic: 4915199 Time: 0.030652
[05/21/2021-07:44:48] [V] [TRT] Tactic: 4980735 Time: 0.072192
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5177343 Time: 0.028464
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5242879 Time: 0.06848
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5373951 Time: 0.027776
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5439487 Time: 0.046172
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5570559 Time: 0.082216
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5636095 Time: 0.044104
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5701631 Time: 0.137856
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5767167 Time: 0.070564
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5832703 Time: 0.078096
[05/21/2021-07:44:48] [V] [TRT] Tactic: 5898239 Time: 0.034328
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6029311 Time: 0.130048
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6225919 Time: 0.038144
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6291455 Time: 0.028416
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6422527 Time: 0.068508
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6750207 Time: 0.03042
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6815743 Time: 0.074932
[05/21/2021-07:44:48] [V] [TRT] Tactic: 6946815 Time: 0.050944
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7012351 Time: 0.021164
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7077887 Time: 0.040448
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7143423 Time: 0.067968
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7208959 Time: 0.07696
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7340031 Time: 0.03328
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7405567 Time: 0.038912
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7536639 Time: 0.115616
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7602175 Time: 0.049152
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7733247 Time: 0.047744
[05/21/2021-07:44:48] [V] [TRT] Tactic: 7798783 Time: 0.053664
[05/21/2021-07:44:48] [V] [TRT] Tactic: 8191999 Time: 0.038272
[05/21/2021-07:44:48] [V] [TRT] Tactic: 8257535 Time: 0.031684
[05/21/2021-07:44:48] [V] [TRT] Tactic: 8323071 Time: 0.046848
[05/21/2021-07:44:48] [V] [TRT] Tactic: 8650751 Time: 0.049572
[05/21/2021-07:44:48] [V] [TRT] Tactic: 8716287 Time: 0.040736
[05/21/2021-07:44:49] [V] [TRT] Tactic: 9109503 Time: 0.021192
[05/21/2021-07:44:49] [V] [TRT] Tactic: 9568255 Time: 0.030408
[05/21/2021-07:44:49] [V] [TRT] Tactic: 9895935 Time: 0.051348
[05/21/2021-07:44:49] [V] [TRT] Tactic: 10223615 Time: 0.145408
[05/21/2021-07:44:49] [V] [TRT] Tactic: 10354687 Time: 0.026496
[05/21/2021-07:44:49] [V] [TRT] Tactic: 10551295 Time: 0.077696
[05/21/2021-07:44:49] [V] [TRT] Tactic: 10747903 Time: 0.04544
[05/21/2021-07:44:49] [V] [TRT] Tactic: 10944511 Time: 0.070736
[05/21/2021-07:44:49] [V] [TRT] Fastest Tactic: 2097151 Time: 0.021164
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2195670545862694453 Time: 0.104712
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3891805945559659536 Time: 0.146432
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:44:49] [V] [TRT] Tactic: 4418200634486186714 Time: 0.084992
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:49] [V] [TRT] Tactic: 5548126322150286555 Time: 0.095616
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:49] [V] [TRT] Tactic: 6057304366605292508 Time: 0.090908
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:44:49] [V] [TRT] Tactic: 7392644644614664811 Time: 0.087192
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:44:49] [V] [TRT] Tactic: -4884039206922900293 Time: 0.144536
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:49] [V] [TRT] Tactic: -4374269919094467161 Time: 0.092484
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:49] [V] [TRT] Tactic: -1546027692247304867 Time: 0.146716
[05/21/2021-07:44:49] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.084992
[05/21/2021-07:44:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[05/21/2021-07:44:49] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(3136,1:8,448,64) ***************
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudaDepthwiseConvolution)
[05/21/2021-07:44:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:49] [V] [TRT] Tactic: 0 Time: 1.17217
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1 Time: 0.175452
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2 Time: 0.134952
[05/21/2021-07:44:49] [V] [TRT] Tactic: 56 Time: 1.17278
[05/21/2021-07:44:49] [V] [TRT] Tactic: 58 Time: 0.130996
[05/21/2021-07:44:49] [V] [TRT] Fastest Tactic: 58 Time: 0.130996
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:49] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:49] [V] [TRT] Tactic: 254850674756030979 Time: 0.077696
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1156328698016730421 Time: 0.046464
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1362727228442059924 Time: 0.04766
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1576319725282257846 Time: 0.024628
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1832046141070096030 Time: 0.02432
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1838082074606840426 Time: 0.023576
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:49] [V] [TRT] Tactic: 1899296423087490472 Time: 0.01472
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2238656696610018305 Time: 0.023552
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2541579301352125276 Time: 0.04096
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2559328254295148085 Time: 0.076468
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0155
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:49] [V] [TRT] Tactic: 2968605903460894194 Time: 0.02432
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3071479995783211391 Time: 0.011272
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3359475309458902373 Time: 0.023932
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3362537467505018070 Time: 0.041472
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3513075359009385578 Time: 0.079028
[05/21/2021-07:44:49] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:49] [V] [TRT] Tactic: 3704534001553878387 Time: 0.043932
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:44:50] [V] [TRT] Tactic: 3899310434460415852 Time: 0.013564
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4278315135102886928 Time: 0.02356
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4370476717970497892 Time: 0.022656
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4480294673430783793 Time: 0.02402
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4491683531415781597 Time: 0.076312
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4528997467275241200 Time: 0.04128
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4571819373777460444 Time: 0.07808
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4595173549602041350 Time: 0.076172
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4802447371470387646 Time: 0.043392
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:44:50] [V] [TRT] Tactic: 4993757826442493905 Time: 0.023648
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:50] [V] [TRT] Tactic: 5059676457552313631 Time: 0.076744
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:44:50] [V] [TRT] Tactic: 5205510332404400949 Time: 0.041236
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:44:50] [V] [TRT] Tactic: 5346855796032465921 Time: 0.04032
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:50] [V] [TRT] Tactic: 5398999388616959893 Time: 0.043016
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:50] [V] [TRT] Tactic: 6034364043891107501 Time: 0.022656
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:50] [V] [TRT] Tactic: 6377497238381488891 Time: 0.04096
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:50] [V] [TRT] Tactic: 6468794451065529747 Time: 0.024884
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:44:50] [V] [TRT] Tactic: 6697277555581639516 Time: 0.023552
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:50] [V] [TRT] Tactic: 6859477213531075460 Time: 0.015488
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:50] [V] [TRT] Tactic: 7216571380637776659 Time: 0.051584
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:50] [V] [TRT] Tactic: 7609923741161019135 Time: 0.024312
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:50] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01664
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:50] [V] [TRT] Tactic: 8170606396342855895 Time: 0.024336
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:44:50] [V] [TRT] Tactic: 8764780417487154889 Time: 0.043
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:44:50] [V] [TRT] Tactic: 8823554289762712606 Time: 0.022528
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:50] [V] [TRT] Tactic: 8839784824303350101 Time: 0.045224
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:44:50] [V] [TRT] Tactic: -9203179519031456182 Time: 0.017328
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:50] [V] [TRT] Tactic: -9009272790678027912 Time: 0.048836
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:50] [V] [TRT] Tactic: -8604374562669615024 Time: 0.015924
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:44:50] [V] [TRT] Tactic: -8280443484414412687 Time: 0.07598
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:44:50] [V] [TRT] Tactic: -8205952393017864204 Time: 0.075588
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:44:50] [V] [TRT] Tactic: -8131857373260504832 Time: 0.024236
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:44:50] [V] [TRT] Tactic: -7410012245391920273 Time: 0.015616
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:44:50] [V] [TRT] Tactic: -7099920365135295801 Time: 0.022528
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:44:50] [V] [TRT] Tactic: -7089118800560870395 Time: 0.014336
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:44:50] [V] [TRT] Tactic: -6768327495007644783 Time: 0.039936
[05/21/2021-07:44:50] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:51] [V] [TRT] Tactic: -6356316196810535311 Time: 0.017036
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:51] [V] [TRT] Tactic: -6063766379489217211 Time: 0.023936
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:51] [V] [TRT] Tactic: -5530886555766748586 Time: 0.041244
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:44:51] [V] [TRT] Tactic: -5409588854490562130 Time: 0.01664
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:51] [V] [TRT] Tactic: -5161596964442251102 Time: 0.024448
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:51] [V] [TRT] Tactic: -5127240325355316006 Time: 0.023552
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4950923835688973492 Time: 0.014812
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4796511246675321840 Time: 0.024584
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4548822885169694805 Time: 0.014764
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4379519430184503304 Time: 0.023552
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4293222705763522367 Time: 0.014336
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4152066959007262150 Time: 0.078464
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:44:51] [V] [TRT] Tactic: -4021926646879732549 Time: 0.023892
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3987638434926559037 Time: 0.024576
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3905653247016903130 Time: 0.044972
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3903342530518878192 Time: 0.041644
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3864869056275745423 Time: 0.042624
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3601464762214218301 Time: 0.015364
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:44:51] [V] [TRT] Tactic: -3058330359340425555 Time: 0.023948
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:44:51] [V] [TRT] Tactic: -2878731503146438856 Time: 0.041728
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:44:51] [V] [TRT] Tactic: -2602982885923184927 Time: 0.040752
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:44:51] [V] [TRT] Tactic: -2353603993968373338 Time: 0.042624
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:44:51] [V] [TRT] Tactic: -2032577876140256150 Time: 0.023812
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:44:51] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0236
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1985778916402815946 Time: 0.045108
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1828674067637788567 Time: 0.01152
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1640527254204634147 Time: 0.023936
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1562548049711204899 Time: 0.041744
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1242202084391243207 Time: 0.023896
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1099247066487349374 Time: 0.015684
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:44:51] [V] [TRT] Tactic: -1038291877007553549 Time: 0.023552
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:44:51] [V] [TRT] Tactic: -406984317033388136 Time: 0.042968
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:44:51] [V] [TRT] Tactic: -331499326992534460 Time: 0.022656
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:44:51] [V] [TRT] Tactic: -206523504474952360 Time: 0.041984
[05/21/2021-07:44:51] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.011272
[05/21/2021-07:44:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391
[05/21/2021-07:44:51] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(1568,1:16,224,32) ***************
[05/21/2021-07:44:51] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CudnnConvolution)
[05/21/2021-07:44:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:51] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CublasConvolution)
[05/21/2021-07:44:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:51] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv1 + stage4_unit2_relu2 (CaskConvolution)
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:44:51] [V] [TRT] Tactic: 162720039126739803 Time: 0.01524
[05/21/2021-07:44:51] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:44:52] [V] [TRT] Tactic: 382577144988222004 Time: 0.023532
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2334614616543277495 Time: 0.02384
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:44:52] [V] [TRT] Tactic: 4126996489741716394 Time: 0.015764
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:44:52] [V] [TRT] Tactic: 6466136707377588846 Time: 0.01022
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:44:52] [V] [TRT] Tactic: 6958123061428231366 Time: 0.014336
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:44:52] [V] [TRT] Tactic: 8940522081427638481 Time: 0.014336
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:44:52] [V] [TRT] Tactic: -7023377647582255231 Time: 0.01472
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:44:52] [V] [TRT] Tactic: -6148657501329441429 Time: 0.016768
[05/21/2021-07:44:52] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:44:52] [V] [TRT] Tactic: -3396930063803107917 Time: 0.011392
[05/21/2021-07:44:52] [V] [TRT] Fastest Tactic: 6466136707377588846 Time: 0.01022
[05/21/2021-07:44:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6466136707377588846
[05/21/2021-07:44:52] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:52] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:52] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:44:52] [V] [TRT] Tactic: 524287 Time: 0.270168
[05/21/2021-07:44:52] [V] [TRT] Tactic: 720895 Time: 0.198784
[05/21/2021-07:44:52] [V] [TRT] Tactic: 983039 Time: 0.101496
[05/21/2021-07:44:52] [V] [TRT] Tactic: 1048575 Time: 0.178268
[05/21/2021-07:44:52] [V] [TRT] Tactic: 1703935 Time: 0.091676
[05/21/2021-07:44:52] [V] [TRT] Tactic: 1769471 Time: 0.086148
[05/21/2021-07:44:52] [V] [TRT] Tactic: 1966079 Time: 0.422192
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2031615 Time: 0.345128
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2228223 Time: 0.161924
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2424831 Time: 0.062848
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2621439 Time: 0.06656
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2752511 Time: 0.213888
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2818047 Time: 0.186112
[05/21/2021-07:44:52] [V] [TRT] Tactic: 2883583 Time: 0.463932
[05/21/2021-07:44:52] [V] [TRT] Tactic: 3014655 Time: 0.101376
[05/21/2021-07:44:52] [V] [TRT] Tactic: 3145727 Time: 0.111232
[05/21/2021-07:44:52] [V] [TRT] Tactic: 3473407 Time: 0.244784
[05/21/2021-07:44:52] [V] [TRT] Tactic: 3604479 Time: 0.106384
[05/21/2021-07:44:53] [V] [TRT] Tactic: 3735551 Time: 0.23744
[05/21/2021-07:44:53] [V] [TRT] Tactic: 4390911 Time: 0.430976
[05/21/2021-07:44:53] [V] [TRT] Tactic: 5046271 Time: 0.159648
[05/21/2021-07:44:53] [V] [TRT] Tactic: 5963775 Time: 0.376336
[05/21/2021-07:44:53] [V] [TRT] Tactic: 6160383 Time: 0.21466
[05/21/2021-07:44:53] [V] [TRT] Tactic: 6488063 Time: 0.191616
[05/21/2021-07:44:53] [V] [TRT] Tactic: 6881279 Time: 0.315404
[05/21/2021-07:44:53] [V] [TRT] Tactic: 7274495 Time: 0.07886
[05/21/2021-07:44:53] [V] [TRT] Tactic: 7864319 Time: 0.070224
[05/21/2021-07:44:53] [V] [TRT] Tactic: 7995391 Time: 0.215964
[05/21/2021-07:44:53] [V] [TRT] Tactic: 8585215 Time: 0.297944
[05/21/2021-07:44:53] [V] [TRT] Tactic: 8847359 Time: 0.073984
[05/21/2021-07:44:53] [V] [TRT] Tactic: 8978431 Time: 0.380728
[05/21/2021-07:44:53] [V] [TRT] Tactic: 9043967 Time: 0.104832
[05/21/2021-07:44:53] [V] [TRT] Tactic: 9175039 Time: 0.106368
[05/21/2021-07:44:53] [V] [TRT] Tactic: 9502719 Time: 0.41662
[05/21/2021-07:44:53] [V] [TRT] Tactic: 9830399 Time: 0.220048
[05/21/2021-07:44:53] [V] [TRT] Tactic: 9961471 Time: 0.071768
[05/21/2021-07:44:53] [V] [TRT] Tactic: 10027007 Time: 0.167168
[05/21/2021-07:44:53] [V] [TRT] Tactic: 10092543 Time: 0.431232
[05/21/2021-07:44:54] [V] [TRT] Tactic: 10289151 Time: 0.422656
[05/21/2021-07:44:54] [V] [TRT] Tactic: 10485759 Time: 0.088576
[05/21/2021-07:44:54] [V] [TRT] Tactic: 10682367 Time: 0.065184
[05/21/2021-07:44:54] [V] [TRT] Tactic: 10813439 Time: 0.11362
[05/21/2021-07:44:54] [V] [TRT] Fastest Tactic: 2424831 Time: 0.062848
[05/21/2021-07:44:54] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:54] [V] [TRT] Tactic: 0 Time: 0.2759
[05/21/2021-07:44:54] [V] [TRT] Tactic: 1 Time: 0.087056
[05/21/2021-07:44:54] [V] [TRT] Tactic: 2 Time: 0.277352
[05/21/2021-07:44:54] [V] [TRT] Tactic: 4 Time: 0.991216
[05/21/2021-07:44:54] [V] [TRT] Tactic: 5 Time: 3.82852
[05/21/2021-07:44:54] [V] [TRT] Tactic: 6 Time: 0.124544
[05/21/2021-07:44:54] [V] [TRT] Tactic: 56 Time: 0.279936
[05/21/2021-07:44:54] [V] [TRT] Tactic: 57 Time: 0.092672
[05/21/2021-07:44:54] [V] [TRT] Tactic: 58 Time: 0.279368
[05/21/2021-07:44:54] [V] [TRT] Tactic: 60 Time: 0.965476
[05/21/2021-07:44:54] [V] [TRT] Tactic: 61 Time: 3.19671
[05/21/2021-07:44:54] [V] [TRT] Tactic: 62 Time: 0.123904
[05/21/2021-07:44:54] [V] [TRT] Tactic: 112 Time: 0.27968
[05/21/2021-07:44:54] [V] [TRT] Tactic: 113 Time: 0.278764
[05/21/2021-07:44:54] [V] [TRT] Tactic: 114 Time: 0.279552
[05/21/2021-07:44:54] [V] [TRT] Tactic: 116 Time: 0.965328
[05/21/2021-07:44:54] [V] [TRT] Tactic: 117 Time: 3.19568
[05/21/2021-07:44:54] [V] [TRT] Tactic: 118 Time: 0.124032
[05/21/2021-07:44:54] [V] [TRT] Fastest Tactic: 1 Time: 0.087056
[05/21/2021-07:44:54] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:44:54] [V] [TRT] Tactic: 4549827808004681195 Time: 0.388096
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:44:54] [V] [TRT] Tactic: 5779835512569528575 Time: 0.495508
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[05/21/2021-07:44:54] [V] [TRT] Tactic: 6053873026024413720 Time: 0.521728
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[05/21/2021-07:44:54] [V] [TRT] Tactic: 6767548733843469815 Time: 0.42834
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:44:54] [V] [TRT] Tactic: -6313876406580483184 Time: 0.542228
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:44:54] [V] [TRT] Tactic: -1123676555321336786 Time: 0.517668
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:44:54] [V] [TRT] Tactic: -701551393537224327 Time: 0.449472
[05/21/2021-07:44:54] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.388096
[05/21/2021-07:44:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831
[05/21/2021-07:44:54] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(25088,1,3584,512) ***************
[05/21/2021-07:44:54] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:54] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:54] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:54] [V] [TRT] Tactic: 2860655430572478466 Time: 0.29008
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:54] [V] [TRT] Tactic: 4474630279712975759 Time: 0.15814
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:54] [V] [TRT] Tactic: 4479823862704990365 Time: 0.153856
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:54] [V] [TRT] Tactic: 4696204239951173149 Time: 0.289136
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:54] [V] [TRT] Tactic: 5778138195697110003 Time: 0.495616
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:44:54] [V] [TRT] Tactic: 7155825427510256858 Time: 0.490508
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:54] [V] [TRT] Tactic: 8918020581761223752 Time: 0.484224
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:44:54] [V] [TRT] Tactic: -4756382386362004279 Time: 0.28288
[05/21/2021-07:44:54] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:44:55] [V] [TRT] Tactic: -3855385237722507464 Time: 0.502744
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:55] [V] [TRT] Tactic: -2809379259463049391 Time: 0.490924
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:55] [V] [TRT] Tactic: -504296718212024303 Time: 0.480136
[05/21/2021-07:44:55] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.153856
[05/21/2021-07:44:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:44:55] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(6272,1:4,896,128) ***************
[05/21/2021-07:44:55] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:55] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:55] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:44:55] [V] [TRT] Tactic: 2860655430572478466 Time: 0.287744
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:44:55] [V] [TRT] Tactic: 4474630279712975759 Time: 0.156928
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:44:55] [V] [TRT] Tactic: 4479823862704990365 Time: 0.155908
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:44:55] [V] [TRT] Tactic: 4696204239951173149 Time: 0.290996
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:44:55] [V] [TRT] Tactic: 5778138195697110003 Time: 0.495744
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[05/21/2021-07:44:55] [V] [TRT] Tactic: 7155825427510256858 Time: 0.490644
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[05/21/2021-07:44:55] [V] [TRT] Tactic: 7342025736444949634 Time: 0.335328
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:44:55] [V] [TRT] Tactic: 8918020581761223752 Time: 0.484224
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[05/21/2021-07:44:55] [V] [TRT] Tactic: -7377458734869418330 Time: 0.328704
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[05/21/2021-07:44:55] [V] [TRT] Tactic: -5457304872213719461 Time: 0.33204
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[05/21/2021-07:44:55] [V] [TRT] Tactic: -4756382386362004279 Time: 0.283136
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[05/21/2021-07:44:55] [V] [TRT] Tactic: -3855385237722507464 Time: 0.502656
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:44:55] [V] [TRT] Tactic: -2809379259463049391 Time: 0.491008
[05/21/2021-07:44:55] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:44:55] [V] [TRT] Tactic: -504296718212024303 Time: 0.479772
[05/21/2021-07:44:55] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 0.155908
[05/21/2021-07:44:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365
[05/21/2021-07:44:55] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:44:55] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:55] [V] [TRT] Tactic: 0 Time: 0.213228
[05/21/2021-07:44:55] [V] [TRT] Tactic: 1 Time: 0.21322
[05/21/2021-07:44:55] [V] [TRT] Tactic: 2 Time: 0.237696
[05/21/2021-07:44:55] [V] [TRT] Tactic: 4 Time: 0.909712
[05/21/2021-07:44:55] [V] [TRT] Tactic: 5 Time: 3.41533
[05/21/2021-07:44:55] [V] [TRT] Tactic: 6 Time: 0.14654
[05/21/2021-07:44:55] [V] [TRT] Tactic: 56 Time: 0.310016
[05/21/2021-07:44:55] [V] [TRT] Tactic: 58 Time: 0.267696
[05/21/2021-07:44:55] [V] [TRT] Tactic: 60 Time: 0.907564
[05/21/2021-07:44:55] [V] [TRT] Tactic: 61 Time: 3.15129
[05/21/2021-07:44:55] [V] [TRT] Tactic: 62 Time: 0.144844
[05/21/2021-07:44:55] [V] [TRT] Fastest Tactic: 62 Time: 0.144844
[05/21/2021-07:44:55] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 62
[05/21/2021-07:44:55] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(12544,49:2,7,1) ***************
[05/21/2021-07:44:55] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (FusedConvActConvolution)
[05/21/2021-07:44:55] [V] [TRT] Tactic: 524287 Time: 0.166668
[05/21/2021-07:44:55] [V] [TRT] Tactic: 720895 Time: 0.127176
[05/21/2021-07:44:55] [V] [TRT] Tactic: 983039 Time: 0.064748
[05/21/2021-07:44:55] [V] [TRT] Tactic: 1048575 Time: 0.081956
[05/21/2021-07:44:55] [V] [TRT] Tactic: 1703935 Time: 0.044296
[05/21/2021-07:44:55] [V] [TRT] Tactic: 1769471 Time: 0.051348
[05/21/2021-07:44:55] [V] [TRT] Tactic: 1966079 Time: 0.212992
[05/21/2021-07:44:55] [V] [TRT] Tactic: 2031615 Time: 0.218368
[05/21/2021-07:44:55] [V] [TRT] Tactic: 2228223 Time: 0.098576
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2424831 Time: 0.039208
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2621439 Time: 0.042008
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2752511 Time: 0.13904
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2818047 Time: 0.118144
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2883583 Time: 0.316044
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3014655 Time: 0.067584
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3145727 Time: 0.0736
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3473407 Time: 0.131072
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3604479 Time: 0.05426
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3735551 Time: 0.10112
[05/21/2021-07:44:56] [V] [TRT] Tactic: 4390911 Time: 0.23312
[05/21/2021-07:44:56] [V] [TRT] Tactic: 5046271 Time: 0.090624
[05/21/2021-07:44:56] [V] [TRT] Tactic: 5963775 Time: 0.276904
[05/21/2021-07:44:56] [V] [TRT] Tactic: 6160383 Time: 0.157056
[05/21/2021-07:44:56] [V] [TRT] Tactic: 6488063 Time: 0.12522
[05/21/2021-07:44:56] [V] [TRT] Tactic: 6881279 Time: 0.20088
[05/21/2021-07:44:56] [V] [TRT] Tactic: 7274495 Time: 0.049072
[05/21/2021-07:44:56] [V] [TRT] Tactic: 7864319 Time: 0.041636
[05/21/2021-07:44:56] [V] [TRT] Tactic: 7995391 Time: 0.152576
[05/21/2021-07:44:56] [V] [TRT] Tactic: 8585215 Time: 0.183424
[05/21/2021-07:44:56] [V] [TRT] Tactic: 8847359 Time: 0.044812
[05/21/2021-07:44:56] [V] [TRT] Tactic: 8978431 Time: 0.195584
[05/21/2021-07:44:56] [V] [TRT] Tactic: 9043967 Time: 0.049536
[05/21/2021-07:44:56] [V] [TRT] Tactic: 9175039 Time: 0.054264
[05/21/2021-07:44:56] [V] [TRT] Tactic: 9502719 Time: 0.231424
[05/21/2021-07:44:56] [V] [TRT] Tactic: 9830399 Time: 0.1472
[05/21/2021-07:44:56] [V] [TRT] Tactic: 9961471 Time: 0.043856
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10027007 Time: 0.09834
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10092543 Time: 0.272256
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10289151 Time: 0.253184
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10485759 Time: 0.052864
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10682367 Time: 0.041124
[05/21/2021-07:44:56] [V] [TRT] Tactic: 10813439 Time: 0.07936
[05/21/2021-07:44:56] [V] [TRT] Fastest Tactic: 2424831 Time: 0.039208
[05/21/2021-07:44:56] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:56] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:56] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:56] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:44:56] [V] [TRT] Tactic: 2195670545862694453 Time: 0.251264
[05/21/2021-07:44:56] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3419182076704469245 Time: 0.233472
[05/21/2021-07:44:56] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:44:56] [V] [TRT] Tactic: 3891805945559659536 Time: 0.326784
[05/21/2021-07:44:56] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:44:57] [V] [TRT] Tactic: 5548126322150286555 Time: 0.23218
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:44:57] [V] [TRT] Tactic: 6057304366605292508 Time: 0.199552
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[05/21/2021-07:44:57] [V] [TRT] Tactic: -7928611605886347652 Time: 0.33746
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:44:57] [V] [TRT] Tactic: -5172391392092686714 Time: 0.28254
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:44:57] [V] [TRT] Tactic: -4374269919094467161 Time: 0.20826
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953
[05/21/2021-07:44:57] [V] [TRT] Tactic: -4083394051665370953 Time: 0.048032
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:44:57] [V] [TRT] Tactic: -1546027692247304867 Time: 0.323072
[05/21/2021-07:44:57] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.048032
[05/21/2021-07:44:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831
[05/21/2021-07:44:57] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(25088,49,7,1) ***************
[05/21/2021-07:44:57] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:57] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:57] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:57] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(3136,1:8,448,64) ***************
[05/21/2021-07:44:57] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudaDepthwiseConvolution)
[05/21/2021-07:44:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:44:57] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:44:57] [V] [TRT] Tactic: 0 Time: 0.237912
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1 Time: 0.240936
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2 Time: 0.182132
[05/21/2021-07:44:57] [V] [TRT] Tactic: 6 Time: 0.136876
[05/21/2021-07:44:57] [V] [TRT] Tactic: 56 Time: 0.235392
[05/21/2021-07:44:57] [V] [TRT] Tactic: 58 Time: 0.181468
[05/21/2021-07:44:57] [V] [TRT] Tactic: 62 Time: 0.135696
[05/21/2021-07:44:57] [V] [TRT] Fastest Tactic: 62 Time: 0.135696
[05/21/2021-07:44:57] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:44:57] [V] [TRT] Tactic: 254850674756030979 Time: 0.165096
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[05/21/2021-07:44:57] [V] [TRT] Tactic: 328038211831149625 Time: 0.162212
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[05/21/2021-07:44:57] [V] [TRT] Tactic: 411553864378931917 Time: 0.045732
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1011057357468998345 Time: 0.09152
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1156328698016730421 Time: 0.097852
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1723736032573714698 Time: 0.04608
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1832046141070096030 Time: 0.047076
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1838082074606840426 Time: 0.046208
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:44:57] [V] [TRT] Tactic: 1899296423087490472 Time: 0.026752
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2428167804343994714 Time: 0.047104
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2541579301352125276 Time: 0.085044
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2657157263811141609 Time: 0.02582
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2819719497590964443 Time: 0.046064
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2968605903460894194 Time: 0.04622
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[05/21/2021-07:44:57] [V] [TRT] Tactic: 2986078304285316765 Time: 0.095468
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:44:57] [V] [TRT] Tactic: 3362537467505018070 Time: 0.084712
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:44:57] [V] [TRT] Tactic: 3513075359009385578 Time: 0.167876
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[05/21/2021-07:44:57] [V] [TRT] Tactic: 3573559043797674382 Time: 0.047872
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[05/21/2021-07:44:57] [V] [TRT] Tactic: 3591970081995419777 Time: 0.026628
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:44:57] [V] [TRT] Tactic: 3704534001553878387 Time: 0.090536
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:44:57] [V] [TRT] Tactic: 4278315135102886928 Time: 0.046208
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[05/21/2021-07:44:57] [V] [TRT] Tactic: 4503233883285355107 Time: 0.031996
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:44:57] [V] [TRT] Tactic: 4802447371470387646 Time: 0.088096
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:44:57] [V] [TRT] Tactic: 5059676457552313631 Time: 0.161928
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:44:57] [V] [TRT] Tactic: 5368829646735632944 Time: 0.02906
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:44:57] [V] [TRT] Tactic: 5398999388616959893 Time: 0.08988
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[05/21/2021-07:44:57] [V] [TRT] Tactic: 5746691132547383910 Time: 0.04672
[05/21/2021-07:44:57] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[05/21/2021-07:44:58] [V] [TRT] Tactic: 5770170567977052602 Time: 0.101808
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[05/21/2021-07:44:58] [V] [TRT] Tactic: 5953552212833506549 Time: 0.085248
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6034364043891107501 Time: 0.045832
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6074229447555668232 Time: 0.029696
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6154447660803990543 Time: 0.04608
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6325769668000961702 Time: 0.085092
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6350273239113254096 Time: 0.019444
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6377497238381488891 Time: 0.083456
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6446388116965632819 Time: 0.046228
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0453
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6642277870194067185 Time: 0.1703
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6859477213531075460 Time: 0.028332
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6972489290272968208 Time: 0.085424
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[05/21/2021-07:44:58] [V] [TRT] Tactic: 6979044990896381511 Time: 0.161808
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:44:58] [V] [TRT] Tactic: 7216571380637776659 Time: 0.117888
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:44:58] [V] [TRT] Tactic: 7609923741161019135 Time: 0.04672
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[05/21/2021-07:44:58] [V] [TRT] Tactic: 7705739241028240201 Time: 0.030976
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[05/21/2021-07:44:58] [V] [TRT] Tactic: 8072087735545283117 Time: 0.16896
[05/21/2021-07:44:58] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:44:59] [V] [TRT] Tactic: 8101703987960976805 Time: 0.03072
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:44:59] [V] [TRT] Tactic: 8170606396342855895 Time: 0.046536
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:44:59] [V] [TRT] Tactic: 8839784824303350101 Time: 0.095628
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[05/21/2021-07:44:59] [V] [TRT] Tactic: -9217371357561775773 Time: 0.029588
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:44:59] [V] [TRT] Tactic: -9009272790678027912 Time: 0.110632
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[05/21/2021-07:44:59] [V] [TRT] Tactic: -8985224497679592364 Time: 0.035332
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[05/21/2021-07:44:59] [V] [TRT] Tactic: -8949544755481315679 Time: 0.047904
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[05/21/2021-07:44:59] [V] [TRT] Tactic: -8759929675070720385 Time: 0.086416
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:44:59] [V] [TRT] Tactic: -8604374562669615024 Time: 0.028384
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6902925267326201166 Time: 0.022068
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6840588038605932325 Time: 0.046616
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6799856376604253964 Time: 0.162432
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6625722781282978136 Time: 0.046464
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6525498856028268801 Time: 0.085136
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6356316196810535311 Time: 0.028952
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6324345858751792783 Time: 0.045344
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6262400699544994312 Time: 0.162304
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6257787336162086472 Time: 0.099328
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:44:59] [V] [TRT] Tactic: -6063766379489217211 Time: 0.046872
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5777580938094193096 Time: 0.048424
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5657273398217409378 Time: 0.166656
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5530886555766748586 Time: 0.092712
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5422685219138380548 Time: 0.045708
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5161596964442251102 Time: 0.046236
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:44:59] [V] [TRT] Tactic: -5127240325355316006 Time: 0.044928
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4825567853927730435 Time: 0.044232
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4796511246675321840 Time: 0.045568
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4706569565442112734 Time: 0.029588
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4566599693570369588 Time: 0.085036
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4409144516525410768 Time: 0.085268
[05/21/2021-07:44:59] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:44:59] [V] [TRT] Tactic: -4379519430184503304 Time: 0.046336
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:45:00] [V] [TRT] Tactic: -4152066959007262150 Time: 0.166656
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:45:00] [V] [TRT] Tactic: -4021926646879732549 Time: 0.04608
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3987638434926559037 Time: 0.046856
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3905653247016903130 Time: 0.092296
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3903974568488493144 Time: 0.05176
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3895429239811098010 Time: 0.045056
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3864869056275745423 Time: 0.085888
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3601464762214218301 Time: 0.027452
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3412636942650049698 Time: 0.092672
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3338665856053412950 Time: 0.085136
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:45:00] [V] [TRT] Tactic: -3058330359340425555 Time: 0.046408
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2816084650627734155 Time: 0.110208
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2662892962457732243 Time: 0.045824
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2559894581585337900 Time: 0.164224
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2530740716768816092 Time: 0.08172
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2332828394978346992 Time: 0.083968
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2241736083352441442 Time: 0.107312
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[05/21/2021-07:45:00] [V] [TRT] Tactic: -2161909437867201546 Time: 0.024696
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:45:00] [V] [TRT] Tactic: -1985778916402815946 Time: 0.101144
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[05/21/2021-07:45:00] [V] [TRT] Tactic: -1500496213132463076 Time: 0.048128
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:45:00] [V] [TRT] Tactic: -1099247066487349374 Time: 0.02786
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:45:00] [V] [TRT] Tactic: -910286698936744682 Time: 0.026624
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[05/21/2021-07:45:00] [V] [TRT] Tactic: -606726295133751039 Time: 0.0489
[05/21/2021-07:45:00] [V] [TRT] Fastest Tactic: 6350273239113254096 Time: 0.019444
[05/21/2021-07:45:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6350273239113254096
[05/21/2021-07:45:00] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(1568,1:16,224,32) ***************
[05/21/2021-07:45:00] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CudnnConvolution)
[05/21/2021-07:45:00] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:00] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv2 + stage4_unit2_relu3 (CaskConvolution)
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32 Tactic: 1301213148470244380
[05/21/2021-07:45:00] [V] [TRT] Tactic: 1301213148470244380 Time: 0.043912
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32 Tactic: 2140378925901736289
[05/21/2021-07:45:00] [V] [TRT] Tactic: 2140378925901736289 Time: 0.039552
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32 Tactic: 7019285522757193163
[05/21/2021-07:45:00] [V] [TRT] Tactic: 7019285522757193163 Time: 0.055924
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: 7616509406849244401
[05/21/2021-07:45:00] [V] [TRT] Tactic: 7616509406849244401 Time: 0.04096
[05/21/2021-07:45:00] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32 Tactic: -6575010824547653277
[05/21/2021-07:45:00] [V] [TRT] Tactic: -6575010824547653277 Time: 0.028288
[05/21/2021-07:45:00] [V] [TRT] Fastest Tactic: -6575010824547653277 Time: 0.028288
[05/21/2021-07:45:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6575010824547653277
[05/21/2021-07:45:00] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:00] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudaDepthwiseConvolution)
[05/21/2021-07:45:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:00] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (FusedConvActConvolution)
[05/21/2021-07:45:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:00] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:00] [V] [TRT] Tactic: 0 Time: 0.042388
[05/21/2021-07:45:00] [V] [TRT] Tactic: 1 Time: 0.036216
[05/21/2021-07:45:00] [V] [TRT] Tactic: 2 Time: 0.136288
[05/21/2021-07:45:00] [V] [TRT] Tactic: 4 Time: 3.85552
[05/21/2021-07:45:00] [V] [TRT] Tactic: 5 Time: 0.699916
[05/21/2021-07:45:00] [V] [TRT] Tactic: 56 Time: 0.042368
[05/21/2021-07:45:01] [V] [TRT] Tactic: 57 Time: 0.036384
[05/21/2021-07:45:01] [V] [TRT] Tactic: 58 Time: 0.136332
[05/21/2021-07:45:01] [V] [TRT] Tactic: 60 Time: 3.86192
[05/21/2021-07:45:01] [V] [TRT] Tactic: 61 Time: 0.69782
[05/21/2021-07:45:01] [V] [TRT] Tactic: 112 Time: 0.042384
[05/21/2021-07:45:01] [V] [TRT] Tactic: 113 Time: 0.036608
[05/21/2021-07:45:01] [V] [TRT] Tactic: 114 Time: 0.13632
[05/21/2021-07:45:01] [V] [TRT] Tactic: 116 Time: 3.85499
[05/21/2021-07:45:01] [V] [TRT] Tactic: 117 Time: 0.70056
[05/21/2021-07:45:01] [V] [TRT] Fastest Tactic: 1 Time: 0.036216
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:45:01] [V] [TRT] Tactic: 4549827808004681195 Time: 0.050164
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:45:01] [V] [TRT] Tactic: 5779835512569528575 Time: 0.063616
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:45:01] [V] [TRT] Tactic: 9151672657204310840 Time: 0.05632
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:45:01] [V] [TRT] Tactic: -7491730084094677098 Time: 0.060452
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:45:01] [V] [TRT] Tactic: -6622064180404051845 Time: 0.067112
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:45:01] [V] [TRT] Tactic: -6313876406580483184 Time: 0.084096
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:45:01] [V] [TRT] Tactic: -6273689210331812572 Time: 0.064552
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:45:01] [V] [TRT] Tactic: -4337126844824617177 Time: 0.050176
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:45:01] [V] [TRT] Tactic: -1123676555321336786 Time: 0.064536
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:45:01] [V] [TRT] Tactic: -701551393537224327 Time: 0.05568
[05/21/2021-07:45:01] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 0.050164
[05/21/2021-07:45:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[05/21/2021-07:45:01] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:45:01] [V] [TRT] Tactic: 1663866669559596164 Time: 0.06406
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:45:01] [V] [TRT] Tactic: 2860655430572478466 Time: 0.04008
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:45:01] [V] [TRT] Tactic: 4474630279712975759 Time: 0.023856
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:45:01] [V] [TRT] Tactic: 4479823862704990365 Time: 0.023996
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:45:01] [V] [TRT] Tactic: 4696204239951173149 Time: 0.039352
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:45:01] [V] [TRT] Tactic: 5778138195697110003 Time: 0.066048
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:45:01] [V] [TRT] Tactic: 8918020581761223752 Time: 0.063368
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:45:01] [V] [TRT] Tactic: -5905193483742532701 Time: 0.037248
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:45:01] [V] [TRT] Tactic: -4035591156787122265 Time: 0.02602
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:45:01] [V] [TRT] Tactic: -2809379259463049391 Time: 0.064268
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:45:01] [V] [TRT] Tactic: -1985235291706575900 Time: 0.062516
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:45:01] [V] [TRT] Tactic: -504296718212024303 Time: 0.06016
[05/21/2021-07:45:01] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 0.023856
[05/21/2021-07:45:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759
[05/21/2021-07:45:01] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:01] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:01] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:45:01] [V] [TRT] Tactic: 1373022415249282411 Time: 0.04298
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:45:01] [V] [TRT] Tactic: 1663866669559596164 Time: 0.062336
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:45:01] [V] [TRT] Tactic: 2860655430572478466 Time: 0.040576
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:45:01] [V] [TRT] Tactic: 4474630279712975759 Time: 0.02702
[05/21/2021-07:45:01] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:45:02] [V] [TRT] Tactic: 4479823862704990365 Time: 0.026676
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:45:02] [V] [TRT] Tactic: 4696204239951173149 Time: 0.04096
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:45:02] [V] [TRT] Tactic: 5778138195697110003 Time: 0.065292
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:45:02] [V] [TRT] Tactic: 8918020581761223752 Time: 0.062508
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:45:02] [V] [TRT] Tactic: -7067026478815706014 Time: 0.045312
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:45:02] [V] [TRT] Tactic: -5905193483742532701 Time: 0.037248
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:45:02] [V] [TRT] Tactic: -4035591156787122265 Time: 0.023552
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:45:02] [V] [TRT] Tactic: -2809379259463049391 Time: 0.06144
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:45:02] [V] [TRT] Tactic: -1985235291706575900 Time: 0.05952
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:45:02] [V] [TRT] Tactic: -504296718212024303 Time: 0.063244
[05/21/2021-07:45:02] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.023552
[05/21/2021-07:45:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:45:02] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1), Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:02] [V] [TRT] Tactic: 0 Time: 0.034752
[05/21/2021-07:45:02] [V] [TRT] Tactic: 1 Time: 0.037556
[05/21/2021-07:45:02] [V] [TRT] Tactic: 2 Time: 0.093208
[05/21/2021-07:45:02] [V] [TRT] Tactic: 4 Time: 3.8504
[05/21/2021-07:45:02] [V] [TRT] Tactic: 5 Time: 0.663852
[05/21/2021-07:45:02] [V] [TRT] Tactic: 56 Time: 0.033932
[05/21/2021-07:45:02] [V] [TRT] Tactic: 58 Time: 0.094024
[05/21/2021-07:45:02] [V] [TRT] Tactic: 60 Time: 3.83356
[05/21/2021-07:45:02] [V] [TRT] Tactic: 61 Time: 0.659932
[05/21/2021-07:45:02] [V] [TRT] Fastest Tactic: 56 Time: 0.033932
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[05/21/2021-07:45:02] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (FusedConvActConvolution)
[05/21/2021-07:45:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:45:02] [V] [TRT] Tactic: 2195670545862694453 Time: 0.032008
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:45:02] [V] [TRT] Tactic: 3891805945559659536 Time: 0.04288
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:45:02] [V] [TRT] Tactic: 4418200634486186714 Time: 0.025856
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:45:02] [V] [TRT] Tactic: 5548126322150286555 Time: 0.028672
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:45:02] [V] [TRT] Tactic: 6057304366605292508 Time: 0.028056
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:45:02] [V] [TRT] Tactic: 7392644644614664811 Time: 0.028188
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:45:02] [V] [TRT] Tactic: -4884039206922900293 Time: 0.04268
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:45:02] [V] [TRT] Tactic: -4374269919094467161 Time: 0.029696
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:45:02] [V] [TRT] Tactic: -1546027692247304867 Time: 0.042928
[05/21/2021-07:45:02] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.025856
[05/21/2021-07:45:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:45:02] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:02] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudaDepthwiseConvolution)
[05/21/2021-07:45:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:02] [V] [TRT] Tactic: 0 Time: 0.589312
[05/21/2021-07:45:02] [V] [TRT] Tactic: 1 Time: 0.05664
[05/21/2021-07:45:02] [V] [TRT] Tactic: 2 Time: 0.078848
[05/21/2021-07:45:02] [V] [TRT] Tactic: 56 Time: 0.589052
[05/21/2021-07:45:02] [V] [TRT] Tactic: 58 Time: 0.071692
[05/21/2021-07:45:02] [V] [TRT] Fastest Tactic: 1 Time: 0.05664
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:02] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:45:02] [V] [TRT] Tactic: 254850674756030979 Time: 0.024952
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:45:02] [V] [TRT] Tactic: 1156328698016730421 Time: 0.018204
[05/21/2021-07:45:02] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:45:03] [V] [TRT] Tactic: 1362727228442059924 Time: 0.017792
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:45:03] [V] [TRT] Tactic: 1576319725282257846 Time: 0.012496
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:45:03] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011848
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:45:03] [V] [TRT] Tactic: 1838082074606840426 Time: 0.011904
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:45:03] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009408
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:45:03] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0118
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:45:03] [V] [TRT] Tactic: 2541579301352125276 Time: 0.016296
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:45:03] [V] [TRT] Tactic: 2559328254295148085 Time: 0.023936
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:45:03] [V] [TRT] Tactic: 2657157263811141609 Time: 0.009192
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:45:03] [V] [TRT] Tactic: 2968605903460894194 Time: 0.011252
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3071479995783211391 Time: 0.00818
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3359475309458902373 Time: 0.011648
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3362537467505018070 Time: 0.01664
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3513075359009385578 Time: 0.026112
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3704534001553878387 Time: 0.016788
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:03] [V] [TRT] Tactic: 3899310434460415852 Time: 0.010548
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011364
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4370476717970497892 Time: 0.01106
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4480294673430783793 Time: 0.009704
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4491683531415781597 Time: 0.023672
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4528997467275241200 Time: 0.014568
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4571819373777460444 Time: 0.025248
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0256
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4802447371470387646 Time: 0.017196
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:45:03] [V] [TRT] Tactic: 4993757826442493905 Time: 0.011008
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:45:03] [V] [TRT] Tactic: 5059676457552313631 Time: 0.025472
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:45:03] [V] [TRT] Tactic: 5205510332404400949 Time: 0.016128
[05/21/2021-07:45:03] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:45:04] [V] [TRT] Tactic: 5346855796032465921 Time: 0.016724
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:45:04] [V] [TRT] Tactic: 5398999388616959893 Time: 0.016896
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:45:04] [V] [TRT] Tactic: 6034364043891107501 Time: 0.010488
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:45:04] [V] [TRT] Tactic: 6377497238381488891 Time: 0.01536
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:45:04] [V] [TRT] Tactic: 6468794451065529747 Time: 0.01152
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:45:04] [V] [TRT] Tactic: 6697277555581639516 Time: 0.010112
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:45:04] [V] [TRT] Tactic: 6859477213531075460 Time: 0.010536
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:45:04] [V] [TRT] Tactic: 7216571380637776659 Time: 0.019024
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:45:04] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011436
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:45:04] [V] [TRT] Tactic: 8101703987960976805 Time: 0.009984
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:45:04] [V] [TRT] Tactic: 8170606396342855895 Time: 0.012128
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:45:04] [V] [TRT] Tactic: 8764780417487154889 Time: 0.01668
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:45:04] [V] [TRT] Tactic: 8823554289762712606 Time: 0.011264
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:45:04] [V] [TRT] Tactic: 8839784824303350101 Time: 0.016372
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:45:04] [V] [TRT] Tactic: -9203179519031456182 Time: 0.008492
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:45:04] [V] [TRT] Tactic: -9009272790678027912 Time: 0.017024
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:45:04] [V] [TRT] Tactic: -8604374562669615024 Time: 0.009472
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:45:04] [V] [TRT] Tactic: -8280443484414412687 Time: 0.025216
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:45:04] [V] [TRT] Tactic: -8205952393017864204 Time: 0.025136
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:45:04] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011648
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:45:04] [V] [TRT] Tactic: -7410012245391920273 Time: 0.009808
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:45:04] [V] [TRT] Tactic: -7099920365135295801 Time: 0.01088
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:45:04] [V] [TRT] Tactic: -7089118800560870395 Time: 0.009248
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:45:04] [V] [TRT] Tactic: -6768327495007644783 Time: 0.01644
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:45:04] [V] [TRT] Tactic: -6356316196810535311 Time: 0.009472
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:45:04] [V] [TRT] Tactic: -6063766379489217211 Time: 0.011224
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:45:04] [V] [TRT] Tactic: -5530886555766748586 Time: 0.01656
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:45:04] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00898
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:45:04] [V] [TRT] Tactic: -5161596964442251102 Time: 0.012152
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:45:04] [V] [TRT] Tactic: -5127240325355316006 Time: 0.010996
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4950923835688973492 Time: 0.008448
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4796511246675321840 Time: 0.012352
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00922
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4379519430184503304 Time: 0.011272
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4293222705763522367 Time: 0.008168
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:45:04] [V] [TRT] Tactic: -4152066959007262150 Time: 0.025256
[05/21/2021-07:45:04] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:45:05] [V] [TRT] Tactic: -4021926646879732549 Time: 0.010856
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3987638434926559037 Time: 0.012672
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3905653247016903130 Time: 0.017408
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3903342530518878192 Time: 0.016576
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3864869056275745423 Time: 0.016952
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3601464762214218301 Time: 0.009092
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3058330359340425555 Time: 0.01194
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:45:05] [V] [TRT] Tactic: -2878731503146438856 Time: 0.016256
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:45:05] [V] [TRT] Tactic: -2602982885923184927 Time: 0.016408
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:45:05] [V] [TRT] Tactic: -2353603993968373338 Time: 0.016984
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:45:05] [V] [TRT] Tactic: -2032577876140256150 Time: 0.011276
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:45:05] [V] [TRT] Tactic: -2003055242756584050 Time: 0.010228
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1985778916402815946 Time: 0.01792
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1828674067637788567 Time: 0.008244
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1640527254204634147 Time: 0.011636
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1562548049711204899 Time: 0.016296
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1242202084391243207 Time: 0.011136
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1099247066487349374 Time: 0.009216
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:45:05] [V] [TRT] Tactic: -1038291877007553549 Time: 0.011264
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:45:05] [V] [TRT] Tactic: -406984317033388136 Time: 0.01664
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:45:05] [V] [TRT] Tactic: -331499326992534460 Time: 0.011264
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:45:05] [V] [TRT] Tactic: -206523504474952360 Time: 0.01534
[05/21/2021-07:45:05] [V] [TRT] Fastest Tactic: -4293222705763522367 Time: 0.008168
[05/21/2021-07:45:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4293222705763522367
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CudnnConvolution)
[05/21/2021-07:45:05] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CublasConvolution)
[05/21/2021-07:45:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit2_conv3 + _plus14 (CaskConvolution)
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:45:05] [V] [TRT] Tactic: 162720039126739803 Time: 0.008372
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:45:05] [V] [TRT] Tactic: 382577144988222004 Time: 0.011392
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:45:05] [V] [TRT] Tactic: 2334614616543277495 Time: 0.01152
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:45:05] [V] [TRT] Tactic: 4126996489741716394 Time: 0.008736
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:05] [V] [TRT] Tactic: 6466136707377588846 Time: 0.008192
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:45:05] [V] [TRT] Tactic: 6958123061428231366 Time: 0.008736
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:45:05] [V] [TRT] Tactic: 8940522081427638481 Time: 0.008496
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:05] [V] [TRT] Tactic: -7023377647582255231 Time: 0.008332
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:45:05] [V] [TRT] Tactic: -6148657501329441429 Time: 0.008276
[05/21/2021-07:45:05] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:05] [V] [TRT] Tactic: -3396930063803107917 Time: 0.007796
[05/21/2021-07:45:05] [V] [TRT] Fastest Tactic: -3396930063803107917 Time: 0.007796
[05/21/2021-07:45:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3396930063803107917
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:05] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:45:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:45:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:05] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:05] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:05] [V] [TRT] Tactic: 0 Time: 0.005008
[05/21/2021-07:45:05] [V] [TRT] Fastest Tactic: 0 Time: 0.005008
[05/21/2021-07:45:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:05] [V] [TRT] Tactic: 0 Time: 0.004516
[05/21/2021-07:45:05] [V] [TRT] Fastest Tactic: 0 Time: 0.004516
[05/21/2021-07:45:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:05] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:45:05] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 0 Time: 0.00512
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_bn1 + stage4_unit3_relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(25088,1,3584,512) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(6272,1:4,896,128) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CaskConvolution)
[05/21/2021-07:45:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(12544,49:2,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Float(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CudnnConvolution)
[05/21/2021-07:45:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CublasConvolution)
[05/21/2021-07:45:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv1 + stage4_unit3_relu2 (CaskConvolution)
[05/21/2021-07:45:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(3136,1:8,448,64) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(1568,1:16,224,32) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1) -> Float(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512) -> Float(25088,1,3584,512) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128) -> Float(6272,1:4,896,128) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1) -> Half(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1) -> Half(12544,49:2,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Float(25088,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CudnnConvolution)
[05/21/2021-07:45:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv2 + stage4_unit3_relu3 (CaskConvolution)
[05/21/2021-07:45:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64) -> Half(3136,1:8,448,64) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32) -> Half(1568,1:16,224,32) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,49,7,1), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,1,3584,512), Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(6272,1:4,896,128), Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(25088,49,7,1), Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(12544,49:2,7,1), Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CudnnConvolution)
[05/21/2021-07:45:06] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CublasConvolution)
[05/21/2021-07:45:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: stage4_unit3_conv3 + _plus15 (CaskConvolution)
[05/21/2021-07:45:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(3136,1:8,448,64), Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(1568,1:16,224,32), Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(100352,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 0 Time: 0.004992
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004992
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(100352,1,14336,2048) -> Float(100352,1,14336,2048) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(25088,1:4,3584,512) -> Float(25088,1:4,3584,512) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(100352,49,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(50176,49:2,7,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 0 Time: 0.00534
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00534
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(12544,1:8,1792,256) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 0 Time: 0.00514
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00514
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(6272,1:16,896,128) -> Half(6272,1:16,896,128) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: bn1 + relu1 (Scale)
[05/21/2021-07:45:06] [V] [TRT] Scale has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Float(100352,49,7,1) -> Float(2048,1,1,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8192257 Time: 0.00512
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8257793 Time: 0.00538
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8323329 Time: 0.005184
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8388865 Time: 0.006144
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8454401 Time: 0.005504
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8519937 Time: 0.005912
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8585473 Time: 0.00532
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8651009 Time: 0.005248
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: 8192257 Time: 0.00512
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling)
[05/21/2021-07:45:06] [V] [TRT] Tactic: -1 Time: 0.005504
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: -1 Time: 0.005504
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8192257
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(100352,49,7,1) -> Half(2048,1,1,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling)
[05/21/2021-07:45:06] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling)
[05/21/2021-07:45:06] [V] [TRT] Tactic: -1 Time: 0.005632
[05/21/2021-07:45:06] [V] [TRT] Fastest Tactic: -1 Time: 0.005632
[05/21/2021-07:45:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1
[05/21/2021-07:45:06] [V] [TRT] *************** Autotuning format combination: Half(50176,49:2,7,1) -> Half(1024,1:2,1,1) ***************
[05/21/2021-07:45:06] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling)
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8192257 Time: 0.005128
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8257793 Time: 0.005504
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8323329 Time: 0.005376
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8388865 Time: 0.005248
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8454401 Time: 0.00568
[05/21/2021-07:45:06] [V] [TRT] Tactic: 8519937 Time: 0.006144
[05/21/2021-07:45:07] [V] [TRT] Tactic: 8585473 Time: 0.006032
[05/21/2021-07:45:07] [V] [TRT] Tactic: 8651009 Time: 0.006016
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 8192257 Time: 0.005128
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: pool1 (CudaPooling)
[05/21/2021-07:45:07] [V] [TRT] Tactic: -3 Time: 0.007628
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: -3 Time: 0.007628
[05/21/2021-07:45:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 8192257
[05/21/2021-07:45:07] [V] [TRT] *************** Autotuning format combination: Half(12544,1:8,1792,256) -> Half(256,1:8,256,256) ***************
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: pool1 (TiledPooling)
[05/21/2021-07:45:07] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: pool1 (CudaPooling)
[05/21/2021-07:45:07] [V] [TRT] Tactic: -2 Time: 0.00758
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: -2 Time: 0.00758
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: pool1 (CudnnPooling)
[05/21/2021-07:45:07] [V] [TRT] Tactic: -1 Time: 0.005984
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: -1 Time: 0.005984
[05/21/2021-07:45:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005632
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004116
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004116
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004148
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004148
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006016
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003968
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003968
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00324
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00324
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006016
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003072
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003072
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,1,1) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00512
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00374
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00374
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005136
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.0032
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0032
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005504
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00448
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00448
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00616
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006276
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00412
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00412
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005704
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(2048,1,2048,2048) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005552
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006604
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006016
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.0041
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0041
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003816
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003816
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00562
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003744
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003744
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00512
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004072
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004072
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Float(512,1:4,512,512) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00512
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003712
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003712
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005532
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00398
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00398
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006436
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.00704
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003476
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003476
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006164
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003636
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003636
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(2048,1,1,1) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006196
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006528
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003328
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003328
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.004128
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.004128
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006152
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003456
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003456
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005936
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003072
[05/21/2021-07:45:07] [V] [TRT] Fastest Tactic: 0 Time: 0.003072
[05/21/2021-07:45:07] [V] [TRT] --------------- Timing Runner: reformat: Half(1024,1:2,1,1) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:07] [V] [TRT] Tactic: 1002 Time: 0.005344
[05/21/2021-07:45:07] [V] [TRT] Tactic: 0 Time: 0.003744
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003744
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.005504
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003072
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003072
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.00512
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003908
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003908
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.005924
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.004096
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.006676
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003252
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003252
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.006664
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003584
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003584
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(256,1:8,256,256) -> Half(128,1:16,128,128) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.0059
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(2048,1,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.004156
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004156
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(2048,1,2048,2048) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.0053
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.004016
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.004016
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Float(512,1:4,512,512) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.00526
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003952
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003952
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(2048,1,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(1024,1:2,1,1) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.003712
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.003712
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: reformat: Half(128,1:16,128,128) -> Half(256,1:8,256,256) (Reformat)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1002 Time: 0.005376
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:45:08] [V] [TRT] *************** Autotuning format combination: Float(2048,1,1,1) -> Float(1000,1,1,1) ***************
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: fc1 (CudaDepthwiseConvolution)
[05/21/2021-07:45:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: fc1 (FusedConvActConvolution)
[05/21/2021-07:45:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:08] [V] [TRT] Tactic: 0 Time: 0.130164
[05/21/2021-07:45:08] [V] [TRT] Tactic: 1 Time: 0.091804
[05/21/2021-07:45:08] [V] [TRT] Tactic: 2 Time: 0.150912
[05/21/2021-07:45:08] [V] [TRT] Tactic: 4 Time: 8.92872
[05/21/2021-07:45:08] [V] [TRT] Tactic: 5 Time: 0.813984
[05/21/2021-07:45:08] [V] [TRT] Tactic: 56 Time: 0.134144
[05/21/2021-07:45:08] [V] [TRT] Tactic: 57 Time: 0.094204
[05/21/2021-07:45:08] [V] [TRT] Tactic: 58 Time: 0.15686
[05/21/2021-07:45:08] [V] [TRT] Tactic: 60 Time: 8.02161
[05/21/2021-07:45:08] [V] [TRT] Tactic: 61 Time: 0.814304
[05/21/2021-07:45:08] [V] [TRT] Tactic: 112 Time: 0.134244
[05/21/2021-07:45:08] [V] [TRT] Tactic: 113 Time: 0.094216
[05/21/2021-07:45:08] [V] [TRT] Tactic: 114 Time: 0.15744
[05/21/2021-07:45:08] [V] [TRT] Tactic: 116 Time: 8.00942
[05/21/2021-07:45:08] [V] [TRT] Tactic: 117 Time: 0.816284
[05/21/2021-07:45:08] [V] [TRT] Fastest Tactic: 1 Time: 0.091804
[05/21/2021-07:45:08] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:09] [V] [TRT] Tactic: 0 Time: 0.019072
[05/21/2021-07:45:09] [V] [TRT] Tactic: 1 Time: 0.02176
[05/21/2021-07:45:09] [V] [TRT] Tactic: 2 Time: 0.027264
[05/21/2021-07:45:09] [V] [TRT] Tactic: 3 Time: 0.02754
[05/21/2021-07:45:09] [V] [TRT] Fastest Tactic: 0 Time: 0.019072
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4549827808004681195 Time: 0.177928
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[05/21/2021-07:45:09] [V] [TRT] Tactic: 5779835512569528575 Time: 0.225152
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[05/21/2021-07:45:09] [V] [TRT] Tactic: 9151672657204310840 Time: 0.181844
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[05/21/2021-07:45:09] [V] [TRT] Tactic: -7491730084094677098 Time: 0.208436
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[05/21/2021-07:45:09] [V] [TRT] Tactic: -6622064180404051845 Time: 0.177648
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[05/21/2021-07:45:09] [V] [TRT] Tactic: -6313876406580483184 Time: 0.217876
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[05/21/2021-07:45:09] [V] [TRT] Tactic: -6273689210331812572 Time: 0.223616
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: sm70_xmma_fprop_conv1x1_f32f32_f32_f32_nchwkcrs_nchw_simt_small_batch_bias_relu Tactic: -6194327789991425125
[05/21/2021-07:45:09] [V] [TRT] Tactic: -6194327789991425125 Time: 0.021504
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[05/21/2021-07:45:09] [V] [TRT] Tactic: -4337126844824617177 Time: 0.164748
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[05/21/2021-07:45:09] [V] [TRT] Tactic: -1123676555321336786 Time: 0.222336
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[05/21/2021-07:45:09] [V] [TRT] Tactic: -701551393537224327 Time: 0.187264
[05/21/2021-07:45:09] [V] [TRT] Fastest Tactic: -6194327789991425125 Time: 0.021504
[05/21/2021-07:45:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CublasConvolution Tactic: 0
[05/21/2021-07:45:09] [V] [TRT] *************** Autotuning format combination: Float(2048,1,2048,2048) -> Float(1000,1,1000,1000) ***************
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:45:09] [V] [TRT] Tactic: 1663866669559596164 Time: 0.22296
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:45:09] [V] [TRT] Tactic: 2860655430572478466 Time: 0.134656
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4474630279712975759 Time: 0.073976
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4479823862704990365 Time: 0.072332
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4696204239951173149 Time: 0.130444
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:45:09] [V] [TRT] Tactic: 5778138195697110003 Time: 0.226048
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:45:09] [V] [TRT] Tactic: 8918020581761223752 Time: 0.217088
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:45:09] [V] [TRT] Tactic: -5905193483742532701 Time: 0.116508
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:45:09] [V] [TRT] Tactic: -4035591156787122265 Time: 0.071708
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:45:09] [V] [TRT] Tactic: -2809379259463049391 Time: 0.222592
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:45:09] [V] [TRT] Tactic: -1985235291706575900 Time: 0.216924
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:45:09] [V] [TRT] Tactic: -504296718212024303 Time: 0.219136
[05/21/2021-07:45:09] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.071708
[05/21/2021-07:45:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:45:09] [V] [TRT] *************** Autotuning format combination: Float(512,1:4,512,512) -> Float(250,1:4,250,250) ***************
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:09] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:09] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[05/21/2021-07:45:09] [V] [TRT] Tactic: 1373022415249282411 Time: 0.153472
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[05/21/2021-07:45:09] [V] [TRT] Tactic: 1663866669559596164 Time: 0.222848
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[05/21/2021-07:45:09] [V] [TRT] Tactic: 2860655430572478466 Time: 0.133792
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4474630279712975759 Time: 0.073608
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[05/21/2021-07:45:09] [V] [TRT] Tactic: 4479823862704990365 Time: 0.072228
[05/21/2021-07:45:09] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[05/21/2021-07:45:10] [V] [TRT] Tactic: 4696204239951173149 Time: 0.1312
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[05/21/2021-07:45:10] [V] [TRT] Tactic: 5778138195697110003 Time: 0.225512
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[05/21/2021-07:45:10] [V] [TRT] Tactic: 8918020581761223752 Time: 0.217048
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[05/21/2021-07:45:10] [V] [TRT] Tactic: -7067026478815706014 Time: 0.15296
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[05/21/2021-07:45:10] [V] [TRT] Tactic: -5905193483742532701 Time: 0.116648
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[05/21/2021-07:45:10] [V] [TRT] Tactic: -4035591156787122265 Time: 0.071808
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[05/21/2021-07:45:10] [V] [TRT] Tactic: -2809379259463049391 Time: 0.222736
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[05/21/2021-07:45:10] [V] [TRT] Tactic: -1985235291706575900 Time: 0.216832
[05/21/2021-07:45:10] [V] [TRT] fc1 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[05/21/2021-07:45:10] [V] [TRT] Tactic: -504296718212024303 Time: 0.219536
[05/21/2021-07:45:10] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.071808
[05/21/2021-07:45:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[05/21/2021-07:45:10] [V] [TRT] *************** Autotuning format combination: Half(2048,1,1,1) -> Half(1000,1,1,1) ***************
[05/21/2021-07:45:10] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:10] [V] [TRT] Tactic: 0 Time: 1.13037
[05/21/2021-07:45:10] [V] [TRT] Tactic: 1 Time: 0.16832
[05/21/2021-07:45:10] [V] [TRT] Tactic: 2 Time: 0.107288
[05/21/2021-07:45:10] [V] [TRT] Tactic: 4 Time: 7.11759
[05/21/2021-07:45:10] [V] [TRT] Tactic: 5 Time: 0.777392
[05/21/2021-07:45:10] [V] [TRT] Tactic: 56 Time: 1.13001
[05/21/2021-07:45:10] [V] [TRT] Tactic: 58 Time: 0.133144
[05/21/2021-07:45:10] [V] [TRT] Tactic: 60 Time: 7.96762
[05/21/2021-07:45:10] [V] [TRT] Tactic: 61 Time: 0.777984
[05/21/2021-07:45:10] [V] [TRT] Fastest Tactic: 2 Time: 0.107288
[05/21/2021-07:45:10] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:10] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Tactic: 0 Time: 9.52146
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Cublas Algo ID 0is requiring more workspace to run, setting to default algo
[05/21/2021-07:45:11] [V] [TRT] Tactic: 1 Time: 8.01343
[05/21/2021-07:45:11] [V] [TRT] Tactic: 2 Time: 0.0256
[05/21/2021-07:45:11] [V] [TRT] Tactic: 3 Time: 0.0256
[05/21/2021-07:45:11] [V] [TRT] Tactic: 4 Time: 0.024576
[05/21/2021-07:45:11] [V] [TRT] Tactic: 5 Time: 0.02176
[05/21/2021-07:45:11] [V] [TRT] Tactic: 6 Time: 0.016768
[05/21/2021-07:45:11] [V] [TRT] Tactic: 7 Time: 0.017024
[05/21/2021-07:45:11] [V] [TRT] Fastest Tactic: 6 Time: 0.016768
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CublasConvolution Tactic: 6
[05/21/2021-07:45:11] [V] [TRT] *************** Autotuning format combination: Half(1024,1:2,1,1) -> Half(1000,1,1,1) ***************
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: sm70_xmma_fprop_conv1x1_f16f16_f16_f16_nchw_vect_c_2kcrs_vect_c_2_nchw_simt_small_batch_bias_relu Tactic: -7852373803729529742
[05/21/2021-07:45:11] [V] [TRT] Tactic: -7852373803729529742 Time: 0.011252
[05/21/2021-07:45:11] [V] [TRT] Fastest Tactic: -7852373803729529742 Time: 0.011252
[05/21/2021-07:45:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7852373803729529742
[05/21/2021-07:45:11] [V] [TRT] *************** Autotuning format combination: Half(1024,1:2,1,1) -> Half(500,1:2,1,1) ***************
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (FusedConvActConvolution)
[05/21/2021-07:45:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[05/21/2021-07:45:11] [V] [TRT] Tactic: 2195670545862694453 Time: 0.108288
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[05/21/2021-07:45:11] [V] [TRT] Tactic: 3891805945559659536 Time: 0.147492
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[05/21/2021-07:45:11] [V] [TRT] Tactic: 4418200634486186714 Time: 0.08724
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[05/21/2021-07:45:11] [V] [TRT] Tactic: 5548126322150286555 Time: 0.09752
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[05/21/2021-07:45:11] [V] [TRT] Tactic: 6057304366605292508 Time: 0.093076
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[05/21/2021-07:45:11] [V] [TRT] Tactic: 7392644644614664811 Time: 0.090884
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[05/21/2021-07:45:11] [V] [TRT] Tactic: -4884039206922900293 Time: 0.144816
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[05/21/2021-07:45:11] [V] [TRT] Tactic: -4374269919094467161 Time: 0.089216
[05/21/2021-07:45:11] [V] [TRT] fc1 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[05/21/2021-07:45:11] [V] [TRT] Tactic: -1546027692247304867 Time: 0.1472
[05/21/2021-07:45:11] [V] [TRT] Fastest Tactic: 4418200634486186714 Time: 0.08724
[05/21/2021-07:45:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4418200634486186714
[05/21/2021-07:45:11] [V] [TRT] *************** Autotuning format combination: Half(256,1:8,256,256) -> Float(1000,1,1,1) ***************
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:11] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] *************** Autotuning format combination: Half(256,1:8,256,256) -> Half(125,1:8,125,125) ***************
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CudaDepthwiseConvolution)
[05/21/2021-07:45:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:11] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:11] [V] [TRT] Tactic: 0 Time: 1.14086
[05/21/2021-07:45:11] [V] [TRT] Tactic: 1 Time: 0.181644
[05/21/2021-07:45:11] [V] [TRT] Tactic: 2 Time: 0.13312
[05/21/2021-07:45:11] [V] [TRT] Tactic: 4 Time: 7.95054
[05/21/2021-07:45:11] [V] [TRT] Tactic: 5 Time: 0.777784
[05/21/2021-07:45:11] [V] [TRT] Tactic: 56 Time: 1.12986
[05/21/2021-07:45:11] [V] [TRT] Tactic: 58 Time: 0.13312
[05/21/2021-07:45:12] [V] [TRT] Tactic: 60 Time: 7.94796
[05/21/2021-07:45:12] [V] [TRT] Tactic: 61 Time: 0.777764
[05/21/2021-07:45:12] [V] [TRT] Fastest Tactic: 2 Time: 0.13312
[05/21/2021-07:45:12] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:12] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[05/21/2021-07:45:12] [V] [TRT] Tactic: 254850674756030979 Time: 0.07888
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1156328698016730421 Time: 0.047248
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1362727228442059924 Time: 0.05248
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1576319725282257846 Time: 0.024004
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1832046141070096030 Time: 0.024116
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1838082074606840426 Time: 0.023676
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[05/21/2021-07:45:12] [V] [TRT] Tactic: 1899296423087490472 Time: 0.01588
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[05/21/2021-07:45:12] [V] [TRT] Tactic: 2238656696610018305 Time: 0.02496
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[05/21/2021-07:45:12] [V] [TRT] Tactic: 2541579301352125276 Time: 0.045868
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[05/21/2021-07:45:12] [V] [TRT] Tactic: 2559328254295148085 Time: 0.076416
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[05/21/2021-07:45:12] [V] [TRT] Tactic: 2657157263811141609 Time: 0.016192
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[05/21/2021-07:45:12] [V] [TRT] Tactic: 2968605903460894194 Time: 0.025112
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3071479995783211391 Time: 0.012468
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3359475309458902373 Time: 0.024192
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3362537467505018070 Time: 0.042112
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3513075359009385578 Time: 0.078512
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3704534001553878387 Time: 0.043068
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:12] [V] [TRT] Tactic: 3899310434460415852 Time: 0.013484
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4278315135102886928 Time: 0.02444
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4370476717970497892 Time: 0.02368
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4480294673430783793 Time: 0.023808
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4491683531415781597 Time: 0.075968
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4528997467275241200 Time: 0.041472
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4571819373777460444 Time: 0.07868
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4595173549602041350 Time: 0.076364
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4802447371470387646 Time: 0.04992
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:45:12] [V] [TRT] Tactic: 4993757826442493905 Time: 0.022528
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[05/21/2021-07:45:12] [V] [TRT] Tactic: 5059676457552313631 Time: 0.07756
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[05/21/2021-07:45:12] [V] [TRT] Tactic: 5205510332404400949 Time: 0.040176
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[05/21/2021-07:45:12] [V] [TRT] Tactic: 5346855796032465921 Time: 0.042496
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[05/21/2021-07:45:12] [V] [TRT] Tactic: 5398999388616959893 Time: 0.044704
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[05/21/2021-07:45:12] [V] [TRT] Tactic: 6034364043891107501 Time: 0.024364
[05/21/2021-07:45:12] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[05/21/2021-07:45:13] [V] [TRT] Tactic: 6377497238381488891 Time: 0.042368
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[05/21/2021-07:45:13] [V] [TRT] Tactic: 6468794451065529747 Time: 0.025344
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[05/21/2021-07:45:13] [V] [TRT] Tactic: 6697277555581639516 Time: 0.023752
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[05/21/2021-07:45:13] [V] [TRT] Tactic: 6859477213531075460 Time: 0.016256
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[05/21/2021-07:45:13] [V] [TRT] Tactic: 7216571380637776659 Time: 0.055576
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[05/21/2021-07:45:13] [V] [TRT] Tactic: 7609923741161019135 Time: 0.024892
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[05/21/2021-07:45:13] [V] [TRT] Tactic: 8101703987960976805 Time: 0.017044
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[05/21/2021-07:45:13] [V] [TRT] Tactic: 8170606396342855895 Time: 0.023936
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[05/21/2021-07:45:13] [V] [TRT] Tactic: 8764780417487154889 Time: 0.042988
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[05/21/2021-07:45:13] [V] [TRT] Tactic: 8823554289762712606 Time: 0.022528
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[05/21/2021-07:45:13] [V] [TRT] Tactic: 8839784824303350101 Time: 0.05184
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[05/21/2021-07:45:13] [V] [TRT] Tactic: -9203179519031456182 Time: 0.018192
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[05/21/2021-07:45:13] [V] [TRT] Tactic: -9009272790678027912 Time: 0.053552
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[05/21/2021-07:45:13] [V] [TRT] Tactic: -8604374562669615024 Time: 0.01666
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[05/21/2021-07:45:13] [V] [TRT] Tactic: -8280443484414412687 Time: 0.077492
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[05/21/2021-07:45:13] [V] [TRT] Tactic: -8205952393017864204 Time: 0.075904
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[05/21/2021-07:45:13] [V] [TRT] Tactic: -8131857373260504832 Time: 0.024192
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[05/21/2021-07:45:13] [V] [TRT] Tactic: -7410012245391920273 Time: 0.016256
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[05/21/2021-07:45:13] [V] [TRT] Tactic: -7099920365135295801 Time: 0.023932
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[05/21/2021-07:45:13] [V] [TRT] Tactic: -7089118800560870395 Time: 0.014848
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:45:13] [V] [TRT] Tactic: -6768327495007644783 Time: 0.040044
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[05/21/2021-07:45:13] [V] [TRT] Tactic: -6356316196810535311 Time: 0.016384
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[05/21/2021-07:45:13] [V] [TRT] Tactic: -6063766379489217211 Time: 0.023552
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[05/21/2021-07:45:13] [V] [TRT] Tactic: -5530886555766748586 Time: 0.046476
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[05/21/2021-07:45:13] [V] [TRT] Tactic: -5409588854490562130 Time: 0.01808
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[05/21/2021-07:45:13] [V] [TRT] Tactic: -5161596964442251102 Time: 0.024956
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[05/21/2021-07:45:13] [V] [TRT] Tactic: -5127240325355316006 Time: 0.024192
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[05/21/2021-07:45:13] [V] [TRT] Tactic: -4950923835688973492 Time: 0.015812
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[05/21/2021-07:45:13] [V] [TRT] Tactic: -4796511246675321840 Time: 0.025116
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[05/21/2021-07:45:13] [V] [TRT] Tactic: -4548822885169694805 Time: 0.016312
[05/21/2021-07:45:13] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[05/21/2021-07:45:14] [V] [TRT] Tactic: -4379519430184503304 Time: 0.02496
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[05/21/2021-07:45:14] [V] [TRT] Tactic: -4293222705763522367 Time: 0.014464
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[05/21/2021-07:45:14] [V] [TRT] Tactic: -4152066959007262150 Time: 0.077568
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[05/21/2021-07:45:14] [V] [TRT] Tactic: -4021926646879732549 Time: 0.023584
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3987638434926559037 Time: 0.025476
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3905653247016903130 Time: 0.045472
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3903342530518878192 Time: 0.046248
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3864869056275745423 Time: 0.047352
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3601464762214218301 Time: 0.016128
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3058330359340425555 Time: 0.024756
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[05/21/2021-07:45:14] [V] [TRT] Tactic: -2878731503146438856 Time: 0.04198
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[05/21/2021-07:45:14] [V] [TRT] Tactic: -2602982885923184927 Time: 0.041984
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[05/21/2021-07:45:14] [V] [TRT] Tactic: -2353603993968373338 Time: 0.043012
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[05/21/2021-07:45:14] [V] [TRT] Tactic: -2032577876140256150 Time: 0.023936
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[05/21/2021-07:45:14] [V] [TRT] Tactic: -2003055242756584050 Time: 0.022884
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1985778916402815946 Time: 0.04416
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1828674067637788567 Time: 0.012832
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1640527254204634147 Time: 0.024864
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1562548049711204899 Time: 0.042368
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1242202084391243207 Time: 0.024224
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1099247066487349374 Time: 0.016128
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[05/21/2021-07:45:14] [V] [TRT] Tactic: -1038291877007553549 Time: 0.024448
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[05/21/2021-07:45:14] [V] [TRT] Tactic: -406984317033388136 Time: 0.04404
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[05/21/2021-07:45:14] [V] [TRT] Tactic: -331499326992534460 Time: 0.024212
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[05/21/2021-07:45:14] [V] [TRT] Tactic: -206523504474952360 Time: 0.041984
[05/21/2021-07:45:14] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.012468
[05/21/2021-07:45:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391
[05/21/2021-07:45:14] [V] [TRT] *************** Autotuning format combination: Half(128,1:16,128,128) -> Half(63,1:16,63,63) ***************
[05/21/2021-07:45:14] [V] [TRT] --------------- Timing Runner: fc1 (CudnnConvolution)
[05/21/2021-07:45:14] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:14] [V] [TRT] --------------- Timing Runner: fc1 (CublasConvolution)
[05/21/2021-07:45:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[05/21/2021-07:45:14] [V] [TRT] --------------- Timing Runner: fc1 (CaskConvolution)
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:45:14] [V] [TRT] Tactic: 162720039126739803 Time: 0.015756
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:45:14] [V] [TRT] Tactic: 382577144988222004 Time: 0.023264
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 2334614616543277495
[05/21/2021-07:45:14] [V] [TRT] Tactic: 2334614616543277495 Time: 0.023888
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:45:14] [V] [TRT] Tactic: 4126996489741716394 Time: 0.015396
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:14] [V] [TRT] Tactic: 6466136707377588846 Time: 0.011792
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6958123061428231366
[05/21/2021-07:45:14] [V] [TRT] Tactic: 6958123061428231366 Time: 0.015132
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_t1r1s1 Tactic: 8940522081427638481
[05/21/2021-07:45:14] [V] [TRT] Tactic: 8940522081427638481 Time: 0.01536
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:14] [V] [TRT] Tactic: -7023377647582255231 Time: 0.01476
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -6148657501329441429
[05/21/2021-07:45:14] [V] [TRT] Tactic: -6148657501329441429 Time: 0.016496
[05/21/2021-07:45:14] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:14] [V] [TRT] Tactic: -3396930063803107917 Time: 0.010356
[05/21/2021-07:45:14] [V] [TRT] Fastest Tactic: -3396930063803107917 Time: 0.010356
[05/21/2021-07:45:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3396930063803107917
[05/21/2021-07:45:14] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1,1) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:14] [V] [TRT] Tactic: 1002 Time: 0.005908
[05/21/2021-07:45:14] [V] [TRT] Tactic: 0 Time: 0.003712
[05/21/2021-07:45:14] [V] [TRT] Fastest Tactic: 0 Time: 0.003712
[05/21/2021-07:45:14] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1000,1000) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.00512
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.004352
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004352
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1,1000,1000) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Float(250,1:4,250,250) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.007
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Float(250,1:4,250,250) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.004224
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1,1,1) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.00376
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00376
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(500,1:2,1,1) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.007168
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003808
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003808
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(500,1:2,1,1) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006304
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003456
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003456
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(125,1:8,125,125) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003328
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003328
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(125,1:8,125,125) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006144
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003088
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003088
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(63,1:16,63,63) -> Float(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.005724
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003812
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003812
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(63,1:16,63,63) -> Half(1000,1,1,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.005652
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003696
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003696
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Float(1000,1,1,1) -> Float(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [Shuffle] (Shuffle)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003072
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1 Time: 0.00812
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003072
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Half(1000,1,1,1) -> Half(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 176) [Shuffle] (Shuffle)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003584
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1 Time: 0.011044
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003584
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Float(1000,1) -> Half(1000,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003992
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003992
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1) -> Float(1000,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006272
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.00384
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00384
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Float(1000,1) -> Float(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: cast1 (Cast)
[05/21/2021-07:45:15] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: cast1 (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006264
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003456
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003456
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Half(1000,1) -> Float(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: cast1 (Cast)
[05/21/2021-07:45:15] [V] [TRT] Cast has no valid tactics for this config, skipping
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: cast1 (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.0064
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003672
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003672
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Float(1000,1) -> Float(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: softmax (CudaSoftMax)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1001 Time: 0.004736
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 1001 Time: 0.004736
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: softmax (CudnnSoftMax)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.005888
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005888
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 1001
[05/21/2021-07:45:15] [V] [TRT] *************** Autotuning format combination: Half(1000,1) -> Half(1000,1) ***************
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: softmax (CudaSoftMax)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1001 Time: 0.00512
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 1001 Time: 0.00512
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: softmax (CudnnSoftMax)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.006016
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.006016
[05/21/2021-07:45:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 1001
[05/21/2021-07:45:15] [V] [TRT] --------------- Timing Runner: reformat: Half(1000,1) -> Float(1000,1) (Reformat)
[05/21/2021-07:45:15] [V] [TRT] Tactic: 1002 Time: 0.006364
[05/21/2021-07:45:15] [V] [TRT] Tactic: 0 Time: 0.003852
[05/21/2021-07:45:15] [V] [TRT] Fastest Tactic: 0 Time: 0.003852
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1 (stage1_unit1_relu1) from Half(100352,3136:2,56,1) to Half(25088,1:8,448,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit1_conv1 + stage1_unit1_relu2 (stage1_unit1_relu1) from Half(25088,1:8,448,8) to Half(12544,1:16,224,4)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit1_conv2 + stage1_unit1_relu3 (stage1_unit1_relu2) from Half(12544,1:16,224,4) to Half(25088,1:8,448,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit1_conv3 (stage1_unit1_relu3) from Half(25088,1:8,448,8) to Half(12544,1:16,224,4)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage1_unit1_sc + _plus0 (stage1_unit1_conv3) from Half(50176,1:16,896,16) to Half(100352,1:8,1792,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit2_conv1 + stage1_unit2_relu2 (stage1_unit2_relu1) from Half(100352,1:8,1792,32) to Half(50176,1:16,896,16)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit2_conv2 + stage1_unit2_relu3 (stage1_unit2_relu2) from Half(12544,1:16,224,4) to Half(25088,1:8,448,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit3_conv1 + stage1_unit3_relu2 (stage1_unit3_relu1) from Half(100352,1:8,1792,32) to Half(50176,1:16,896,16)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage1_unit3_conv2 + stage1_unit3_relu3 (stage1_unit3_relu2) from Half(12544,1:16,224,4) to Half(25088,1:8,448,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit1_conv3 (stage2_unit1_relu3) from Half(12544,1:8,448,16) to Half(6272,1:16,224,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage2_unit1_sc + _plus3 (stage2_unit1_conv3) from Half(25088,1:16,896,32) to Half(50176,1:8,1792,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit2_conv3 + _plus4 (stage2_unit2_relu3) from Half(12544,1:8,448,16) to Half(6272,1:16,224,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage2_unit2_conv3 + _plus4 (_plus3) from Half(50176,1:8,1792,64) to Half(25088,1:16,896,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit3_bn1 + stage2_unit3_relu1 (_plus4) from Half(25088,1:16,896,32) to Half(50176,1:8,1792,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit3_conv3 + _plus5 (stage2_unit3_relu3) from Half(12544,1:8,448,16) to Half(6272,1:16,224,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit4_bn1 + stage2_unit4_relu1 (_plus5) from Half(25088,1:16,896,32) to Half(50176,1:8,1792,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage2_unit4_conv3 + _plus6 (stage2_unit4_relu3) from Half(12544,1:8,448,16) to Half(6272,1:16,224,8)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit1_bn1 + stage3_unit1_relu1 (_plus6) from Half(25088,1:16,896,32) to Half(50176,1:8,1792,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit1_conv1 + stage3_unit1_relu2 (stage3_unit1_relu1) from Half(50176,1:8,1792,64) to Half(25088,1:16,896,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit1_conv2 + stage3_unit1_relu3 (stage3_unit1_relu2) from Half(12544,1:16,448,16) to Half(25088,1:8,896,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit1_conv3 (stage3_unit1_relu3) from Half(6272,1:8,448,32) to Half(3136,1:16,224,16)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage3_unit1_sc + _plus7 (stage3_unit1_conv3) from Half(12544,1:16,896,64) to Half(25088,1:8,1792,128)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit2_conv1 + stage3_unit2_relu2 (stage3_unit2_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit2_conv2 + stage3_unit2_relu3 (stage3_unit2_relu2) from Half(3136,1:16,224,16) to Half(6272,1:8,448,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit3_conv1 + stage3_unit3_relu2 (stage3_unit3_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit3_conv2 + stage3_unit3_relu3 (stage3_unit3_relu2) from Half(3136,1:16,224,16) to Half(6272,1:8,448,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit4_conv1 + stage3_unit4_relu2 (stage3_unit4_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit4_conv2 + stage3_unit4_relu3 (stage3_unit4_relu2) from Half(3136,1:16,224,16) to Half(6272,1:8,448,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit5_conv1 + stage3_unit5_relu2 (stage3_unit5_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit5_conv2 + stage3_unit5_relu3 (stage3_unit5_relu2) from Half(3136,1:16,224,16) to Half(6272,1:8,448,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit6_conv1 + stage3_unit6_relu2 (stage3_unit6_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage3_unit6_conv2 + stage3_unit6_relu3 (stage3_unit6_relu2) from Half(3136,1:16,224,16) to Half(6272,1:8,448,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit1_conv1 + stage4_unit1_relu2 (stage4_unit1_relu1) from Half(25088,1:8,1792,128) to Half(12544,1:16,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit1_conv2 + stage4_unit1_relu3 (stage4_unit1_relu2) from Half(6272,1:16,448,32) to Half(12544,1:8,896,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit1_conv3 (stage4_unit1_relu3) from Half(3136,1:8,448,64) to Half(1568,1:16,224,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage4_unit1_sc + _plus13 (stage4_unit1_conv3) from Half(6272,1:16,896,128) to Half(12544,1:8,1792,256)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit2_conv1 + stage4_unit2_relu2 (stage4_unit2_relu1) from Half(12544,1:8,1792,256) to Half(6272,1:16,896,128)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit2_conv2 + stage4_unit2_relu3 (stage4_unit2_relu2) from Half(1568,1:16,224,32) to Half(3136,1:8,448,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit2_conv3 + _plus14 (stage4_unit2_relu3) from Half(3136,1:8,448,64) to Half(1568,1:16,224,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to stage4_unit2_conv3 + _plus14 (_plus13) from Half(12544,1:8,1792,256) to Half(6272,1:16,896,128)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit3_bn1 + stage4_unit3_relu1 (_plus14) from Half(6272,1:16,896,128) to Half(12544,1:8,1792,256)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit3_conv1 + stage4_unit3_relu2 (stage4_unit3_relu1) from Half(12544,1:8,1792,256) to Half(6272,1:16,896,128)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit3_conv2 + stage4_unit3_relu3 (stage4_unit3_relu2) from Half(1568,1:16,224,32) to Half(3136,1:8,448,64)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to stage4_unit3_conv3 + _plus15 (stage4_unit3_relu3) from Half(3136,1:8,448,64) to Half(1568,1:16,224,32)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to bn1 + relu1 (_plus15) from Half(6272,1:16,896,128) to Half(12544,1:8,1792,256)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to fc1 (pool1) from Half(256,1:8,256,256) to Half(128,1:16,128,128)
[05/21/2021-07:45:15] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to (Unnamed Layer* 176) [Shuffle] ((Unnamed Layer* 175) [Fully Connected]_output) from Half(63,1:16,63,63) to Float(1000,1,1,1)
[05/21/2021-07:45:15] [V] [TRT] For layer (Unnamed Layer* 176) [Shuffle] a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation.
[05/21/2021-07:45:15] [V] [TRT] For layer softmax a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation.
[05/21/2021-07:45:15] [V] [TRT] Formats and tactics selection completed in 220.193 seconds.
[05/21/2021-07:45:15] [V] [TRT] After reformat layers: 125 layers
[05/21/2021-07:45:15] [V] [TRT] Block size 8589934592
[05/21/2021-07:45:15] [V] [TRT] Block size 1605632
[05/21/2021-07:45:15] [V] [TRT] Block size 1605632
[05/21/2021-07:45:15] [V] [TRT] Block size 1605632
[05/21/2021-07:45:15] [V] [TRT] Block size 802816
[05/21/2021-07:45:15] [V] [TRT] Block size 1
[05/21/2021-07:45:15] [V] [TRT] Block size 1
[05/21/2021-07:45:15] [V] [TRT] Block size 1
[05/21/2021-07:45:15] [V] [TRT] Total Activation Memory: 8595554307
[05/21/2021-07:45:15] [I] [TRT] Detected 1 inputs and 1 output network tensors.
[05/21/2021-07:45:15] [V] [TRT] conv0 + relu0 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[05/21/2021-07:45:15] [V] [TRT] stage1_unit1_conv1 + stage1_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:45:15] [V] [TRT] stage1_unit1_conv2 + stage1_unit1_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:15] [V] [TRT] stage1_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 382577144988222004
[05/21/2021-07:45:15] [V] [TRT] stage1_unit1_sc + _plus0 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:45:15] [V] [TRT] stage1_unit2_conv1 + stage1_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:15] [V] [TRT] stage1_unit2_conv2 + stage1_unit2_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:15] [V] [TRT] stage1_unit2_conv3 + _plus1 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:45:15] [V] [TRT] stage1_unit3_conv1 + stage1_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:15] [V] [TRT] stage1_unit3_conv2 + stage1_unit3_relu3 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[05/21/2021-07:45:15] [V] [TRT] stage1_unit3_conv3 + _plus2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[05/21/2021-07:45:15] [V] [TRT] stage2_unit1_conv1 + stage2_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[05/21/2021-07:45:15] [V] [TRT] stage2_unit1_conv2 + stage2_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:45:15] [V] [TRT] stage2_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x64_stage3_warpsize1x4x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 162720039126739803
[05/21/2021-07:45:15] [V] [TRT] stage2_unit1_sc + _plus3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[05/21/2021-07:45:15] [V] [TRT] stage2_unit2_conv1 + stage2_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:45:15] [V] [TRT] stage2_unit2_conv2 + stage2_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:45:15] [V] [TRT] stage2_unit2_conv3 + _plus4 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:45:15] [V] [TRT] stage2_unit3_conv1 + stage2_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:45:15] [V] [TRT] stage2_unit3_conv2 + stage2_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:45:15] [V] [TRT] stage2_unit3_conv3 + _plus5 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:45:15] [V] [TRT] stage2_unit4_conv1 + stage2_unit4_relu2 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[05/21/2021-07:45:15] [V] [TRT] stage2_unit4_conv2 + stage2_unit4_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[05/21/2021-07:45:15] [V] [TRT] stage2_unit4_conv3 + _plus6 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_t1r1s1 Tactic: 4126996489741716394
[05/21/2021-07:45:15] [V] [TRT] stage3_unit1_conv1 + stage3_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:16] [V] [TRT] stage3_unit1_conv2 + stage3_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage3_warpsize1x2x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: -7023377647582255231
[05/21/2021-07:45:16] [V] [TRT] stage3_unit1_sc + _plus7 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[05/21/2021-07:45:16] [V] [TRT] stage3_unit2_conv1 + stage3_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage3_unit2_conv2 + stage3_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit2_conv3 + _plus8 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:16] [V] [TRT] stage3_unit3_conv1 + stage3_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage3_unit3_conv2 + stage3_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit3_conv3 + _plus9 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:16] [V] [TRT] stage3_unit4_conv1 + stage3_unit4_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage3_unit4_conv2 + stage3_unit4_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit4_conv3 + _plus10 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:16] [V] [TRT] stage3_unit5_conv1 + stage3_unit5_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage3_unit5_conv2 + stage3_unit5_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit5_conv3 + _plus11 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:16] [V] [TRT] stage3_unit6_conv1 + stage3_unit6_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage3_unit6_conv2 + stage3_unit6_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage3_unit6_conv3 + _plus12 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[05/21/2021-07:45:16] [V] [TRT] stage4_unit1_conv1 + stage4_unit1_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage4_unit1_conv2 + stage4_unit1_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage4_unit1_conv3 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:16] [V] [TRT] stage4_unit1_sc + _plus13 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[05/21/2021-07:45:16] [V] [TRT] stage4_unit2_conv1 + stage4_unit2_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage4_unit2_conv2 + stage4_unit2_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage4_unit2_conv3 + _plus14 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:16] [V] [TRT] stage4_unit3_conv1 + stage4_unit3_relu2 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_simple_t1r1s1 Tactic: 6466136707377588846
[05/21/2021-07:45:16] [V] [TRT] stage4_unit3_conv2 + stage4_unit3_relu3 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[05/21/2021-07:45:16] [V] [TRT] stage4_unit3_conv3 + _plus15 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:16] [V] [TRT] fc1 Set Tactic Name: sm80_xmma_fprop_sparse_conv_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x16x64_stage3_warpsize1x1x1_g1_sptensor16x8x32_t1r1s1 Tactic: -3396930063803107917
[05/21/2021-07:45:16] [V] [TRT] Layer: cast0 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: bn_data HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: conv0 + relu0 HostPersistent: 4224 DevicePersistent: 100864
[05/21/2021-07:45:16] [V] [TRT] Layer: pooling0 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit1_bn1 + stage1_unit1_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit1_conv1 + stage1_unit1_relu2 HostPersistent: 3616 DevicePersistent: 5120
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit1_conv2 + stage1_unit1_relu3 HostPersistent: 1664 DevicePersistent: 93184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit1_conv3 HostPersistent: 3616 DevicePersistent: 20480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit1_sc + _plus0 HostPersistent: 3776 DevicePersistent: 34816
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit2_bn1 + stage1_unit2_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit2_conv1 + stage1_unit2_relu2 HostPersistent: 3616 DevicePersistent: 18944
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit2_conv2 + stage1_unit2_relu3 HostPersistent: 1664 DevicePersistent: 93184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit2_conv3 + _plus1 HostPersistent: 3776 DevicePersistent: 34816
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit3_bn1 + stage1_unit3_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit3_conv1 + stage1_unit3_relu2 HostPersistent: 3616 DevicePersistent: 18944
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit3_conv2 + stage1_unit3_relu3 HostPersistent: 1664 DevicePersistent: 93184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage1_unit3_conv3 + _plus2 HostPersistent: 3776 DevicePersistent: 34816
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit1_bn1 + stage2_unit1_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit1_conv1 + stage2_unit1_relu2 HostPersistent: 3776 DevicePersistent: 66560
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit1_conv2 + stage2_unit1_relu3 HostPersistent: 3776 DevicePersistent: 295936
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit1_conv3 HostPersistent: 3616 DevicePersistent: 77824
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit1_sc + _plus3 HostPersistent: 3776 DevicePersistent: 266240
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit2_bn1 + stage2_unit2_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit2_conv1 + stage2_unit2_relu2 HostPersistent: 3776 DevicePersistent: 132096
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit2_conv2 + stage2_unit2_relu3 HostPersistent: 3776 DevicePersistent: 295936
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit2_conv3 + _plus4 HostPersistent: 3616 DevicePersistent: 77824
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit3_bn1 + stage2_unit3_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit3_conv1 + stage2_unit3_relu2 HostPersistent: 3776 DevicePersistent: 132096
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit3_conv2 + stage2_unit3_relu3 HostPersistent: 3776 DevicePersistent: 295936
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit3_conv3 + _plus5 HostPersistent: 3616 DevicePersistent: 77824
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit4_bn1 + stage2_unit4_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit4_conv1 + stage2_unit4_relu2 HostPersistent: 3776 DevicePersistent: 132096
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit4_conv2 + stage2_unit4_relu3 HostPersistent: 3776 DevicePersistent: 295936
[05/21/2021-07:45:16] [V] [TRT] Layer: stage2_unit4_conv3 + _plus6 HostPersistent: 3616 DevicePersistent: 77824
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit1_bn1 + stage3_unit1_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit1_conv1 + stage3_unit1_relu2 HostPersistent: 3616 DevicePersistent: 148992
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit1_conv2 + stage3_unit1_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit1_conv3 HostPersistent: 3616 DevicePersistent: 303104
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit1_sc + _plus7 HostPersistent: 2496 DevicePersistent: 1056768
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit2_bn1 + stage3_unit2_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit2_conv1 + stage3_unit2_relu2 HostPersistent: 3616 DevicePersistent: 296448
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit2_conv2 + stage3_unit2_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit2_conv3 + _plus8 HostPersistent: 3776 DevicePersistent: 532480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit3_bn1 + stage3_unit3_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit3_conv1 + stage3_unit3_relu2 HostPersistent: 3616 DevicePersistent: 296448
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit3_conv2 + stage3_unit3_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit3_conv3 + _plus9 HostPersistent: 3776 DevicePersistent: 532480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit4_bn1 + stage3_unit4_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit4_conv1 + stage3_unit4_relu2 HostPersistent: 3616 DevicePersistent: 296448
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit4_conv2 + stage3_unit4_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit4_conv3 + _plus10 HostPersistent: 3776 DevicePersistent: 532480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit5_bn1 + stage3_unit5_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit5_conv1 + stage3_unit5_relu2 HostPersistent: 3616 DevicePersistent: 296448
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit5_conv2 + stage3_unit5_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit5_conv3 + _plus11 HostPersistent: 3776 DevicePersistent: 532480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit6_bn1 + stage3_unit6_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit6_conv1 + stage3_unit6_relu2 HostPersistent: 3616 DevicePersistent: 296448
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit6_conv2 + stage3_unit6_relu3 HostPersistent: 3776 DevicePersistent: 1181184
[05/21/2021-07:45:16] [V] [TRT] Layer: stage3_unit6_conv3 + _plus12 HostPersistent: 3776 DevicePersistent: 532480
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit1_bn1 + stage4_unit1_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit1_conv1 + stage4_unit1_relu2 HostPersistent: 3616 DevicePersistent: 592896
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit1_conv2 + stage4_unit1_relu3 HostPersistent: 3776 DevicePersistent: 4721664
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit1_conv3 HostPersistent: 3616 DevicePersistent: 1196032
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit1_sc + _plus13 HostPersistent: 3776 DevicePersistent: 4210688
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit2_bn1 + stage4_unit2_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit2_conv1 + stage4_unit2_relu2 HostPersistent: 3616 DevicePersistent: 1182720
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit2_conv2 + stage4_unit2_relu3 HostPersistent: 3776 DevicePersistent: 4721664
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit2_conv3 + _plus14 HostPersistent: 3616 DevicePersistent: 1196032
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit3_bn1 + stage4_unit3_relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit3_conv1 + stage4_unit3_relu2 HostPersistent: 3616 DevicePersistent: 1182720
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit3_conv2 + stage4_unit3_relu3 HostPersistent: 3776 DevicePersistent: 4721664
[05/21/2021-07:45:16] [V] [TRT] Layer: stage4_unit3_conv3 + _plus15 HostPersistent: 3616 DevicePersistent: 1196032
[05/21/2021-07:45:16] [V] [TRT] Layer: bn1 + relu1 HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: pool1 HostPersistent: 48 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: fc1 HostPersistent: 3616 DevicePersistent: 2332672
[05/21/2021-07:45:16] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to (Unnamed Layer* 176) [Shuffle] HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [V] [TRT] Layer: softmax HostPersistent: 0 DevicePersistent: 0
[05/21/2021-07:45:16] [I] [TRT] Total Host Persistent Memory: 193264
[05/21/2021-07:45:16] [I] [TRT] Total Device Persistent Memory: 42767872
[05/21/2021-07:45:16] [I] [TRT] Total Scratch Memory: 0
[05/21/2021-07:45:16] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 112 MiB, GPU 4 MiB
[05/21/2021-07:45:16] [I] [TRT] (Sparsity) Layers eligible for sparse math: stage1_unit1_conv1 + stage1_unit1_relu2, stage1_unit1_conv2 + stage1_unit1_relu3, stage1_unit1_conv3, stage1_unit1_sc + _plus0, stage1_unit2_conv1 + stage1_unit2_relu2, stage1_unit2_conv2 + stage1_unit2_relu3, stage1_unit2_conv3 + _plus1, stage1_unit3_conv1 + stage1_unit3_relu2, stage1_unit3_conv2 + stage1_unit3_relu3, stage1_unit3_conv3 + _plus2, stage2_unit1_conv1 + stage2_unit1_relu2, stage2_unit1_conv2 + stage2_unit1_relu3, stage2_unit1_conv3, stage2_unit1_sc + _plus3, stage2_unit2_conv1 + stage2_unit2_relu2, stage2_unit2_conv2 + stage2_unit2_relu3, stage2_unit2_conv3 + _plus4, stage2_unit3_conv1 + stage2_unit3_relu2, stage2_unit3_conv2 + stage2_unit3_relu3, stage2_unit3_conv3 + _plus5, stage2_unit4_conv1 + stage2_unit4_relu2, stage2_unit4_conv2 + stage2_unit4_relu3, stage2_unit4_conv3 + _plus6, stage3_unit1_conv1 + stage3_unit1_relu2, stage3_unit1_conv2 + stage3_unit1_relu3, stage3_unit1_conv3, stage3_unit1_sc + _plus7, stage3_unit2_conv1 + stage3_unit2_relu2, stage3_unit2_conv2 + stage3_unit2_relu3, stage3_unit2_conv3 + _plus8, stage3_unit3_conv1 + stage3_unit3_relu2, stage3_unit3_conv2 + stage3_unit3_relu3, stage3_unit3_conv3 + _plus9, stage3_unit4_conv1 + stage3_unit4_relu2, stage3_unit4_conv2 + stage3_unit4_relu3, stage3_unit4_conv3 + _plus10, stage3_unit5_conv1 + stage3_unit5_relu2, stage3_unit5_conv2 + stage3_unit5_relu3, stage3_unit5_conv3 + _plus11, stage3_unit6_conv1 + stage3_unit6_relu2, stage3_unit6_conv2 + stage3_unit6_relu3, stage3_unit6_conv3 + _plus12, stage4_unit1_conv1 + stage4_unit1_relu2, stage4_unit1_conv2 + stage4_unit1_relu3, stage4_unit1_conv3, stage4_unit1_sc + _plus13, stage4_unit2_conv1 + stage4_unit2_relu2, stage4_unit2_conv2 + stage4_unit2_relu3, stage4_unit2_conv3 + _plus14, stage4_unit3_conv1 + stage4_unit3_relu2, stage4_unit3_conv2 + stage4_unit3_relu3, stage4_unit3_conv3 + _plus15, fc1
[05/21/2021-07:45:16] [I] [TRT] (Sparsity) TRT inference plan picked sparse implementation for layers: stage1_unit1_conv1 + stage1_unit1_relu2, stage1_unit1_conv3, stage1_unit2_conv1 + stage1_unit2_relu2, stage1_unit3_conv1 + stage1_unit3_relu2, stage2_unit1_conv3, stage2_unit2_conv3 + _plus4, stage2_unit3_conv3 + _plus5, stage2_unit4_conv3 + _plus6, stage3_unit1_conv1 + stage3_unit1_relu2, stage3_unit1_conv3, stage3_unit2_conv1 + stage3_unit2_relu2, stage3_unit3_conv1 + stage3_unit3_relu2, stage3_unit4_conv1 + stage3_unit4_relu2, stage3_unit5_conv1 + stage3_unit5_relu2, stage3_unit6_conv1 + stage3_unit6_relu2, stage4_unit1_conv1 + stage4_unit1_relu2, stage4_unit1_conv3, stage4_unit2_conv1 + stage4_unit2_relu2, stage4_unit2_conv3 + _plus14, stage4_unit3_conv1 + stage4_unit3_relu2, stage4_unit3_conv3 + _plus15, fc1
[05/21/2021-07:45:16] [V] [TRT] Using cublasLt a tactic source
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 2538, GPU 11586 (MiB)
[05/21/2021-07:45:16] [V] [TRT] Using cuDNN as a tactic source
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 2538, GPU 11594 (MiB)
[05/21/2021-07:45:16] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2538, GPU 11578 (MiB)
[05/21/2021-07:45:16] [V] [TRT] Engine generation completed in 221.984 seconds.
[05/21/2021-07:45:16] [V] [TRT] Deleting timing cache: 1014 entries, 3826 hits
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2537, GPU 11560 (MiB)
[05/21/2021-07:45:16] [V] [TRT] Engine Layer Information:
Layer(Reformat): cast0, Tactic: 0, data[Float(1,3,224,224)] -> cast0[Half(1,3,224,224)]
Layer(Scale): bn_data, Tactic: 0, cast0[Half(1,3,224,224)] -> bn_data[Half(1,3,224,224)]
Layer(CaskConvolution): conv0 + relu0, Tactic: -5172391392092686714, bn_data[Half(1,3,224,224)] -> relu0[Half(1,64,112,112)]
Layer(CudaPooling): pooling0, Tactic: -3, relu0[Half(1,64,112,112)] -> pooling0[Half(1,64,56,56)]
Layer(Scale): stage1_unit1_bn1 + stage1_unit1_relu1, Tactic: 0, pooling0[Half(1,64,56,56)] -> Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1[Half(1,64,56,56)]
Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1, Tactic: 0, Reformatted Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1[Half(1,64,56,56)] -> stage1_unit1_relu1[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit1_conv1 + stage1_unit1_relu2, Tactic: 162720039126739803, Reformatted Input Tensor 0 to stage1_unit1_conv1 + stage1_unit1_relu2[Half(1,64,56,56)] -> stage1_unit1_relu2[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit1_conv2 + stage1_unit1_relu3, Tactic: -3601464762214218301, Reformatted Input Tensor 0 to stage1_unit1_conv2 + stage1_unit1_relu3[Half(1,64,56,56)] -> stage1_unit1_relu3[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit1_conv3, Tactic: 382577144988222004, Reformatted Input Tensor 0 to stage1_unit1_conv3[Half(1,64,56,56)] -> stage1_unit1_conv3[Half(1,256,56,56)]
Layer(CaskConvolution): stage1_unit1_sc + _plus0, Tactic: -6768327495007644783, stage1_unit1_relu1[Half(1,64,56,56)], Reformatted Input Tensor 1 to stage1_unit1_sc + _plus0[Half(1,256,56,56)] -> _plus0[Half(1,256,56,56)]
Layer(Scale): stage1_unit2_bn1 + stage1_unit2_relu1, Tactic: 0, _plus0[Half(1,256,56,56)] -> stage1_unit2_relu1[Half(1,256,56,56)]
Layer(CaskConvolution): stage1_unit2_conv1 + stage1_unit2_relu2, Tactic: -7023377647582255231, Reformatted Input Tensor 0 to stage1_unit2_conv1 + stage1_unit2_relu2[Half(1,256,56,56)] -> stage1_unit2_relu2[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit2_conv2 + stage1_unit2_relu3, Tactic: -3601464762214218301, Reformatted Input Tensor 0 to stage1_unit2_conv2 + stage1_unit2_relu3[Half(1,64,56,56)] -> stage1_unit2_relu3[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit2_conv3 + _plus1, Tactic: -6768327495007644783, stage1_unit2_relu3[Half(1,64,56,56)], _plus0[Half(1,256,56,56)] -> _plus1[Half(1,256,56,56)]
Layer(Scale): stage1_unit3_bn1 + stage1_unit3_relu1, Tactic: 0, _plus1[Half(1,256,56,56)] -> stage1_unit3_relu1[Half(1,256,56,56)]
Layer(CaskConvolution): stage1_unit3_conv1 + stage1_unit3_relu2, Tactic: -7023377647582255231, Reformatted Input Tensor 0 to stage1_unit3_conv1 + stage1_unit3_relu2[Half(1,256,56,56)] -> stage1_unit3_relu2[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit3_conv2 + stage1_unit3_relu3, Tactic: -3601464762214218301, Reformatted Input Tensor 0 to stage1_unit3_conv2 + stage1_unit3_relu3[Half(1,64,56,56)] -> stage1_unit3_relu3[Half(1,64,56,56)]
Layer(CaskConvolution): stage1_unit3_conv3 + _plus2, Tactic: -6768327495007644783, stage1_unit3_relu3[Half(1,64,56,56)], _plus1[Half(1,256,56,56)] -> _plus2[Half(1,256,56,56)]
Layer(Scale): stage2_unit1_bn1 + stage2_unit1_relu1, Tactic: 0, _plus2[Half(1,256,56,56)] -> stage2_unit1_relu1[Half(1,256,56,56)]
Layer(CaskConvolution): stage2_unit1_conv1 + stage2_unit1_relu2, Tactic: 4993757826442493905, stage2_unit1_relu1[Half(1,256,56,56)] -> stage2_unit1_relu2[Half(1,128,56,56)]
Layer(CaskConvolution): stage2_unit1_conv2 + stage2_unit1_relu3, Tactic: -6902925267326201166, stage2_unit1_relu2[Half(1,128,56,56)] -> stage2_unit1_relu3[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit1_conv3, Tactic: 162720039126739803, Reformatted Input Tensor 0 to stage2_unit1_conv3[Half(1,128,28,28)] -> stage2_unit1_conv3[Half(1,512,28,28)]
Layer(CaskConvolution): stage2_unit1_sc + _plus3, Tactic: -4825567853927730435, stage2_unit1_relu1[Half(1,256,56,56)], Reformatted Input Tensor 1 to stage2_unit1_sc + _plus3[Half(1,512,28,28)] -> _plus3[Half(1,512,28,28)]
Layer(Scale): stage2_unit2_bn1 + stage2_unit2_relu1, Tactic: 0, _plus3[Half(1,512,28,28)] -> stage2_unit2_relu1[Half(1,512,28,28)]
Layer(CaskConvolution): stage2_unit2_conv1 + stage2_unit2_relu2, Tactic: -1828674067637788567, stage2_unit2_relu1[Half(1,512,28,28)] -> stage2_unit2_relu2[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit2_conv2 + stage2_unit2_relu3, Tactic: -6902925267326201166, stage2_unit2_relu2[Half(1,128,28,28)] -> stage2_unit2_relu3[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit2_conv3 + _plus4, Tactic: 4126996489741716394, Reformatted Input Tensor 0 to stage2_unit2_conv3 + _plus4[Half(1,128,28,28)], Reformatted Input Tensor 1 to stage2_unit2_conv3 + _plus4[Half(1,512,28,28)] -> _plus4[Half(1,512,28,28)]
Layer(Scale): stage2_unit3_bn1 + stage2_unit3_relu1, Tactic: 0, Reformatted Input Tensor 0 to stage2_unit3_bn1 + stage2_unit3_relu1[Half(1,512,28,28)] -> stage2_unit3_relu1[Half(1,512,28,28)]
Layer(CaskConvolution): stage2_unit3_conv1 + stage2_unit3_relu2, Tactic: -1828674067637788567, stage2_unit3_relu1[Half(1,512,28,28)] -> stage2_unit3_relu2[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit3_conv2 + stage2_unit3_relu3, Tactic: -6902925267326201166, stage2_unit3_relu2[Half(1,128,28,28)] -> stage2_unit3_relu3[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit3_conv3 + _plus5, Tactic: 4126996489741716394, Reformatted Input Tensor 0 to stage2_unit3_conv3 + _plus5[Half(1,128,28,28)], _plus4[Half(1,512,28,28)] -> _plus5[Half(1,512,28,28)]
Layer(Scale): stage2_unit4_bn1 + stage2_unit4_relu1, Tactic: 0, Reformatted Input Tensor 0 to stage2_unit4_bn1 + stage2_unit4_relu1[Half(1,512,28,28)] -> stage2_unit4_relu1[Half(1,512,28,28)]
Layer(CaskConvolution): stage2_unit4_conv1 + stage2_unit4_relu2, Tactic: -1828674067637788567, stage2_unit4_relu1[Half(1,512,28,28)] -> stage2_unit4_relu2[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit4_conv2 + stage2_unit4_relu3, Tactic: -6902925267326201166, stage2_unit4_relu2[Half(1,128,28,28)] -> stage2_unit4_relu3[Half(1,128,28,28)]
Layer(CaskConvolution): stage2_unit4_conv3 + _plus6, Tactic: 4126996489741716394, Reformatted Input Tensor 0 to stage2_unit4_conv3 + _plus6[Half(1,128,28,28)], _plus5[Half(1,512,28,28)] -> _plus6[Half(1,512,28,28)]
Layer(Scale): stage3_unit1_bn1 + stage3_unit1_relu1, Tactic: 0, Reformatted Input Tensor 0 to stage3_unit1_bn1 + stage3_unit1_relu1[Half(1,512,28,28)] -> stage3_unit1_relu1[Half(1,512,28,28)]
Layer(CaskConvolution): stage3_unit1_conv1 + stage3_unit1_relu2, Tactic: -7023377647582255231, Reformatted Input Tensor 0 to stage3_unit1_conv1 + stage3_unit1_relu2[Half(1,512,28,28)] -> stage3_unit1_relu2[Half(1,256,28,28)]
Layer(CaskConvolution): stage3_unit1_conv2 + stage3_unit1_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit1_conv2 + stage3_unit1_relu3[Half(1,256,28,28)] -> stage3_unit1_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit1_conv3, Tactic: -7023377647582255231, Reformatted Input Tensor 0 to stage3_unit1_conv3[Half(1,256,14,14)] -> stage3_unit1_conv3[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit1_sc + _plus7, Tactic: 5368829646735632944, stage3_unit1_relu1[Half(1,512,28,28)], Reformatted Input Tensor 1 to stage3_unit1_sc + _plus7[Half(1,1024,14,14)] -> _plus7[Half(1,1024,14,14)]
Layer(Scale): stage3_unit2_bn1 + stage3_unit2_relu1, Tactic: 0, _plus7[Half(1,1024,14,14)] -> stage3_unit2_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit2_conv1 + stage3_unit2_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage3_unit2_conv1 + stage3_unit2_relu2[Half(1,1024,14,14)] -> stage3_unit2_relu2[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit2_conv2 + stage3_unit2_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit2_conv2 + stage3_unit2_relu3[Half(1,256,14,14)] -> stage3_unit2_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit2_conv3 + _plus8, Tactic: 3899310434460415852, stage3_unit2_relu3[Half(1,256,14,14)], _plus7[Half(1,1024,14,14)] -> _plus8[Half(1,1024,14,14)]
Layer(Scale): stage3_unit3_bn1 + stage3_unit3_relu1, Tactic: 0, _plus8[Half(1,1024,14,14)] -> stage3_unit3_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit3_conv1 + stage3_unit3_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage3_unit3_conv1 + stage3_unit3_relu2[Half(1,1024,14,14)] -> stage3_unit3_relu2[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit3_conv2 + stage3_unit3_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit3_conv2 + stage3_unit3_relu3[Half(1,256,14,14)] -> stage3_unit3_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit3_conv3 + _plus9, Tactic: 3899310434460415852, stage3_unit3_relu3[Half(1,256,14,14)], _plus8[Half(1,1024,14,14)] -> _plus9[Half(1,1024,14,14)]
Layer(Scale): stage3_unit4_bn1 + stage3_unit4_relu1, Tactic: 0, _plus9[Half(1,1024,14,14)] -> stage3_unit4_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit4_conv1 + stage3_unit4_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage3_unit4_conv1 + stage3_unit4_relu2[Half(1,1024,14,14)] -> stage3_unit4_relu2[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit4_conv2 + stage3_unit4_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit4_conv2 + stage3_unit4_relu3[Half(1,256,14,14)] -> stage3_unit4_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit4_conv3 + _plus10, Tactic: 3899310434460415852, stage3_unit4_relu3[Half(1,256,14,14)], _plus9[Half(1,1024,14,14)] -> _plus10[Half(1,1024,14,14)]
Layer(Scale): stage3_unit5_bn1 + stage3_unit5_relu1, Tactic: 0, _plus10[Half(1,1024,14,14)] -> stage3_unit5_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit5_conv1 + stage3_unit5_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage3_unit5_conv1 + stage3_unit5_relu2[Half(1,1024,14,14)] -> stage3_unit5_relu2[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit5_conv2 + stage3_unit5_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit5_conv2 + stage3_unit5_relu3[Half(1,256,14,14)] -> stage3_unit5_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit5_conv3 + _plus11, Tactic: 3899310434460415852, stage3_unit5_relu3[Half(1,256,14,14)], _plus10[Half(1,1024,14,14)] -> _plus11[Half(1,1024,14,14)]
Layer(Scale): stage3_unit6_bn1 + stage3_unit6_relu1, Tactic: 0, _plus11[Half(1,1024,14,14)] -> stage3_unit6_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage3_unit6_conv1 + stage3_unit6_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage3_unit6_conv1 + stage3_unit6_relu2[Half(1,1024,14,14)] -> stage3_unit6_relu2[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit6_conv2 + stage3_unit6_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage3_unit6_conv2 + stage3_unit6_relu3[Half(1,256,14,14)] -> stage3_unit6_relu3[Half(1,256,14,14)]
Layer(CaskConvolution): stage3_unit6_conv3 + _plus12, Tactic: 3899310434460415852, stage3_unit6_relu3[Half(1,256,14,14)], _plus11[Half(1,1024,14,14)] -> _plus12[Half(1,1024,14,14)]
Layer(Scale): stage4_unit1_bn1 + stage4_unit1_relu1, Tactic: 0, _plus12[Half(1,1024,14,14)] -> stage4_unit1_relu1[Half(1,1024,14,14)]
Layer(CaskConvolution): stage4_unit1_conv1 + stage4_unit1_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage4_unit1_conv1 + stage4_unit1_relu2[Half(1,1024,14,14)] -> stage4_unit1_relu2[Half(1,512,14,14)]
Layer(CaskConvolution): stage4_unit1_conv2 + stage4_unit1_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage4_unit1_conv2 + stage4_unit1_relu3[Half(1,512,14,14)] -> stage4_unit1_relu3[Half(1,512,7,7)]
Layer(CaskConvolution): stage4_unit1_conv3, Tactic: -3396930063803107917, Reformatted Input Tensor 0 to stage4_unit1_conv3[Half(1,512,7,7)] -> stage4_unit1_conv3[Half(1,2048,7,7)]
Layer(CaskConvolution): stage4_unit1_sc + _plus13, Tactic: -910286698936744682, stage4_unit1_relu1[Half(1,1024,14,14)], Reformatted Input Tensor 1 to stage4_unit1_sc + _plus13[Half(1,2048,7,7)] -> _plus13[Half(1,2048,7,7)]
Layer(Scale): stage4_unit2_bn1 + stage4_unit2_relu1, Tactic: 0, _plus13[Half(1,2048,7,7)] -> stage4_unit2_relu1[Half(1,2048,7,7)]
Layer(CaskConvolution): stage4_unit2_conv1 + stage4_unit2_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage4_unit2_conv1 + stage4_unit2_relu2[Half(1,2048,7,7)] -> stage4_unit2_relu2[Half(1,512,7,7)]
Layer(CaskConvolution): stage4_unit2_conv2 + stage4_unit2_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage4_unit2_conv2 + stage4_unit2_relu3[Half(1,512,7,7)] -> stage4_unit2_relu3[Half(1,512,7,7)]
Layer(CaskConvolution): stage4_unit2_conv3 + _plus14, Tactic: -3396930063803107917, Reformatted Input Tensor 0 to stage4_unit2_conv3 + _plus14[Half(1,512,7,7)], Reformatted Input Tensor 1 to stage4_unit2_conv3 + _plus14[Half(1,2048,7,7)] -> _plus14[Half(1,2048,7,7)]
Layer(Scale): stage4_unit3_bn1 + stage4_unit3_relu1, Tactic: 0, Reformatted Input Tensor 0 to stage4_unit3_bn1 + stage4_unit3_relu1[Half(1,2048,7,7)] -> stage4_unit3_relu1[Half(1,2048,7,7)]
Layer(CaskConvolution): stage4_unit3_conv1 + stage4_unit3_relu2, Tactic: 6466136707377588846, Reformatted Input Tensor 0 to stage4_unit3_conv1 + stage4_unit3_relu2[Half(1,2048,7,7)] -> stage4_unit3_relu2[Half(1,512,7,7)]
Layer(CaskConvolution): stage4_unit3_conv2 + stage4_unit3_relu3, Tactic: 6350273239113254096, Reformatted Input Tensor 0 to stage4_unit3_conv2 + stage4_unit3_relu3[Half(1,512,7,7)] -> stage4_unit3_relu3[Half(1,512,7,7)]
Layer(CaskConvolution): stage4_unit3_conv3 + _plus15, Tactic: -3396930063803107917, Reformatted Input Tensor 0 to stage4_unit3_conv3 + _plus15[Half(1,512,7,7)], _plus14[Half(1,2048,7,7)] -> _plus15[Half(1,2048,7,7)]
Layer(Scale): bn1 + relu1, Tactic: 0, Reformatted Input Tensor 0 to bn1 + relu1[Half(1,2048,7,7)] -> relu1[Half(1,2048,7,7)]
Layer(CudnnPooling): pool1, Tactic: -1, relu1[Half(1,2048,7,7)] -> pool1[Half(1,2048,1,1)]
Layer(CaskConvolution): fc1, Tactic: -3396930063803107917, Reformatted Input Tensor 0 to fc1[Half(1,2048,1,1)] -> (Unnamed Layer* 175) [Fully Connected]_output[Half(1,1000,1,1)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to (Unnamed Layer* 176) [Shuffle], Tactic: 0, (Unnamed Layer* 175) [Fully Connected]_output[Half(1,1000,1,1)] -> Reformatted Input Tensor 0 to (Unnamed Layer* 176) [Shuffle][Float(1,1000,1,1)]
Layer(CudaSoftMax): softmax, Tactic: 1001, cast1[Float(1,1000)] -> softmax[Float(1,1000)]
[05/21/2021-07:45:16] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 2477 MiB, GPU 11560 MiB
[05/21/2021-07:45:16] [I] Engine built in 225.378 sec.
[05/21/2021-07:45:16] [V] [TRT] Using cublasLt a tactic source
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 2281, GPU 11570 (MiB)
[05/21/2021-07:45:16] [V] [TRT] Using cuDNN as a tactic source
[05/21/2021-07:45:16] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 2281, GPU 11578 (MiB)
[05/21/2021-07:45:16] [W] [TRT] TensorRT was linked against cuDNN 8.2.0 but loaded cuDNN 8.0.4
[05/21/2021-07:45:16] [V] [TRT] Total per-runner device memory is 42767872
[05/21/2021-07:45:16] [V] [TRT] Total per-runner host memory is 193264
[05/21/2021-07:45:16] [V] [TRT] Allocated activation device memory of size 5219840
[05/21/2021-07:45:16] [I] Created input binding for data with dimensions 1x3x224x224
[05/21/2021-07:45:16] [I] Created output binding for softmax with dimensions 1x1000
[05/21/2021-07:45:16] [I] Starting inference
[05/21/2021-07:45:19] [I] Warmup completed 318 queries over 200 ms
[05/21/2021-07:45:19] [I] Timing trace has 4819 queries over 3.00179 s
[05/21/2021-07:45:19] [I] 
[05/21/2021-07:45:19] [I] === Trace details ===
[05/21/2021-07:45:19] [I] Trace averages of 10 runs:
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601608 ms - Host latency: 0.656616 ms (end to end 1.18032 ms, enqueue 0.296199 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627917 ms - Host latency: 0.682371 ms (end to end 1.21781 ms, enqueue 0.292099 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.60549 ms - Host latency: 0.66071 ms (end to end 1.16151 ms, enqueue 0.298137 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621568 ms - Host latency: 0.676358 ms (end to end 1.19687 ms, enqueue 0.295905 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613272 ms - Host latency: 0.667944 ms (end to end 1.1592 ms, enqueue 0.29384 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.591676 ms - Host latency: 0.646526 ms (end to end 1.15809 ms, enqueue 0.296559 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617679 ms - Host latency: 0.672427 ms (end to end 1.1872 ms, enqueue 0.298952 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617064 ms - Host latency: 0.671706 ms (end to end 1.17087 ms, enqueue 0.29343 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596487 ms - Host latency: 0.651047 ms (end to end 1.17155 ms, enqueue 0.294388 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614601 ms - Host latency: 0.669203 ms (end to end 1.18797 ms, enqueue 0.294072 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59679 ms - Host latency: 0.6522 ms (end to end 1.14423 ms, enqueue 0.298126 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627505 ms - Host latency: 0.682504 ms (end to end 1.2092 ms, enqueue 0.296564 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630994 ms - Host latency: 0.686014 ms (end to end 1.19076 ms, enqueue 0.296478 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596884 ms - Host latency: 0.651703 ms (end to end 1.17318 ms, enqueue 0.296115 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614606 ms - Host latency: 0.669818 ms (end to end 1.179 ms, enqueue 0.29808 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618082 ms - Host latency: 0.673004 ms (end to end 1.17342 ms, enqueue 0.30014 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592691 ms - Host latency: 0.647421 ms (end to end 1.1617 ms, enqueue 0.295224 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616251 ms - Host latency: 0.671014 ms (end to end 1.18739 ms, enqueue 0.298465 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594235 ms - Host latency: 0.649072 ms (end to end 1.14625 ms, enqueue 0.328604 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614096 ms - Host latency: 0.66915 ms (end to end 1.18794 ms, enqueue 0.351941 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61973 ms - Host latency: 0.675247 ms (end to end 1.16148 ms, enqueue 0.296948 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602316 ms - Host latency: 0.657898 ms (end to end 1.20078 ms, enqueue 0.360736 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631613 ms - Host latency: 0.687283 ms (end to end 1.21783 ms, enqueue 0.295731 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625974 ms - Host latency: 0.681177 ms (end to end 1.18035 ms, enqueue 0.29725 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596997 ms - Host latency: 0.651633 ms (end to end 1.17896 ms, enqueue 0.292157 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614087 ms - Host latency: 0.668704 ms (end to end 1.18327 ms, enqueue 0.296176 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.615112 ms - Host latency: 0.669916 ms (end to end 1.16474 ms, enqueue 0.29415 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592899 ms - Host latency: 0.647665 ms (end to end 1.16023 ms, enqueue 0.296503 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625153 ms - Host latency: 0.682672 ms (end to end 1.18055 ms, enqueue 0.294287 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597198 ms - Host latency: 0.652243 ms (end to end 1.1751 ms, enqueue 0.296387 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610407 ms - Host latency: 0.665277 ms (end to end 1.17773 ms, enqueue 0.294449 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.634268 ms - Host latency: 0.689175 ms (end to end 1.19737 ms, enqueue 0.294751 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.599048 ms - Host latency: 0.654025 ms (end to end 1.18287 ms, enqueue 0.2944 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.63447 ms - Host latency: 0.689844 ms (end to end 1.22345 ms, enqueue 0.296304 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61665 ms - Host latency: 0.672183 ms (end to end 1.16534 ms, enqueue 0.296991 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597198 ms - Host latency: 0.651874 ms (end to end 1.17237 ms, enqueue 0.294406 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.62085 ms - Host latency: 0.675858 ms (end to end 1.19846 ms, enqueue 0.294156 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596478 ms - Host latency: 0.650809 ms (end to end 1.1507 ms, enqueue 0.293478 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617169 ms - Host latency: 0.672025 ms (end to end 1.18491 ms, enqueue 0.298935 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611838 ms - Host latency: 0.666348 ms (end to end 1.15971 ms, enqueue 0.294385 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588901 ms - Host latency: 0.643826 ms (end to end 1.15317 ms, enqueue 0.296677 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623422 ms - Host latency: 0.678586 ms (end to end 1.20053 ms, enqueue 0.296368 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627402 ms - Host latency: 0.682257 ms (end to end 1.18372 ms, enqueue 0.294431 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.606619 ms - Host latency: 0.661847 ms (end to end 1.19525 ms, enqueue 0.296283 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618085 ms - Host latency: 0.672562 ms (end to end 1.1942 ms, enqueue 0.294284 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589822 ms - Host latency: 0.644907 ms (end to end 1.13226 ms, enqueue 0.296423 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613583 ms - Host latency: 0.668317 ms (end to end 1.18168 ms, enqueue 0.296405 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613275 ms - Host latency: 0.667731 ms (end to end 1.16132 ms, enqueue 0.296671 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592288 ms - Host latency: 0.647083 ms (end to end 1.16186 ms, enqueue 0.293784 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618082 ms - Host latency: 0.672913 ms (end to end 1.1888 ms, enqueue 0.296426 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61337 ms - Host latency: 0.668253 ms (end to end 1.1626 ms, enqueue 0.294022 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.600769 ms - Host latency: 0.655615 ms (end to end 1.17956 ms, enqueue 0.294415 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631201 ms - Host latency: 0.686066 ms (end to end 1.21784 ms, enqueue 0.296545 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.603021 ms - Host latency: 0.657947 ms (end to end 1.15995 ms, enqueue 0.29715 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626892 ms - Host latency: 0.681287 ms (end to end 1.21295 ms, enqueue 0.294208 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617578 ms - Host latency: 0.672504 ms (end to end 1.16475 ms, enqueue 0.297821 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.5927 ms - Host latency: 0.650861 ms (end to end 1.15737 ms, enqueue 0.301465 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614917 ms - Host latency: 0.670038 ms (end to end 1.18162 ms, enqueue 0.295825 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617053 ms - Host latency: 0.671832 ms (end to end 1.16368 ms, enqueue 0.297034 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594232 ms - Host latency: 0.649121 ms (end to end 1.16872 ms, enqueue 0.294836 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617462 ms - Host latency: 0.672443 ms (end to end 1.18715 ms, enqueue 0.298041 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617767 ms - Host latency: 0.673792 ms (end to end 1.15701 ms, enqueue 0.294763 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602203 ms - Host latency: 0.657697 ms (end to end 1.1853 ms, enqueue 0.296796 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627411 ms - Host latency: 0.682745 ms (end to end 1.21382 ms, enqueue 0.29198 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601398 ms - Host latency: 0.65614 ms (end to end 1.15734 ms, enqueue 0.29696 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628113 ms - Host latency: 0.68266 ms (end to end 1.21606 ms, enqueue 0.292682 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616449 ms - Host latency: 0.671277 ms (end to end 1.16498 ms, enqueue 0.296374 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594751 ms - Host latency: 0.649359 ms (end to end 1.1657 ms, enqueue 0.296368 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61972 ms - Host latency: 0.674341 ms (end to end 1.19291 ms, enqueue 0.296228 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617566 ms - Host latency: 0.672235 ms (end to end 1.167 ms, enqueue 0.298285 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593622 ms - Host latency: 0.64892 ms (end to end 1.15719 ms, enqueue 0.296716 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.609796 ms - Host latency: 0.664636 ms (end to end 1.17747 ms, enqueue 0.295087 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598822 ms - Host latency: 0.653491 ms (end to end 1.15664 ms, enqueue 0.292291 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.635382 ms - Host latency: 0.690326 ms (end to end 1.22432 ms, enqueue 0.298285 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631696 ms - Host latency: 0.686768 ms (end to end 1.19033 ms, enqueue 0.296558 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.58963 ms - Host latency: 0.644397 ms (end to end 1.15919 ms, enqueue 0.296423 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617365 ms - Host latency: 0.672302 ms (end to end 1.18907 ms, enqueue 0.296558 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619611 ms - Host latency: 0.674274 ms (end to end 1.17244 ms, enqueue 0.294629 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597003 ms - Host latency: 0.651318 ms (end to end 1.17874 ms, enqueue 0.291785 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616553 ms - Host latency: 0.670972 ms (end to end 1.18721 ms, enqueue 0.296735 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59259 ms - Host latency: 0.647192 ms (end to end 1.14308 ms, enqueue 0.294354 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622394 ms - Host latency: 0.677539 ms (end to end 1.20218 ms, enqueue 0.294 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.63006 ms - Host latency: 0.68526 ms (end to end 1.21361 ms, enqueue 0.295703 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.605798 ms - Host latency: 0.660651 ms (end to end 1.16546 ms, enqueue 0.296613 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628741 ms - Host latency: 0.683881 ms (end to end 1.21346 ms, enqueue 0.295203 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621875 ms - Host latency: 0.676105 ms (end to end 1.18779 ms, enqueue 0.290143 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592505 ms - Host latency: 0.647247 ms (end to end 1.1639 ms, enqueue 0.293158 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617999 ms - Host latency: 0.672583 ms (end to end 1.19241 ms, enqueue 0.294238 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613904 ms - Host latency: 0.668439 ms (end to end 1.16074 ms, enqueue 0.294562 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593207 ms - Host latency: 0.648163 ms (end to end 1.1642 ms, enqueue 0.297211 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614703 ms - Host latency: 0.669098 ms (end to end 1.18801 ms, enqueue 0.294208 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597192 ms - Host latency: 0.651855 ms (end to end 1.15304 ms, enqueue 0.292242 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620752 ms - Host latency: 0.675378 ms (end to end 1.19701 ms, enqueue 0.296393 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.629242 ms - Host latency: 0.684363 ms (end to end 1.18644 ms, enqueue 0.296283 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.604163 ms - Host latency: 0.658881 ms (end to end 1.19172 ms, enqueue 0.294427 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.62998 ms - Host latency: 0.684668 ms (end to end 1.21605 ms, enqueue 0.296576 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621661 ms - Host latency: 0.676196 ms (end to end 1.17267 ms, enqueue 0.296582 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594019 ms - Host latency: 0.648566 ms (end to end 1.16862 ms, enqueue 0.294135 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616656 ms - Host latency: 0.671283 ms (end to end 1.19089 ms, enqueue 0.294873 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627405 ms - Host latency: 0.682025 ms (end to end 1.18848 ms, enqueue 0.294281 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592688 ms - Host latency: 0.647559 ms (end to end 1.16108 ms, enqueue 0.298047 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618207 ms - Host latency: 0.673053 ms (end to end 1.18909 ms, enqueue 0.296686 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592389 ms - Host latency: 0.647473 ms (end to end 1.13644 ms, enqueue 0.296368 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627814 ms - Host latency: 0.682623 ms (end to end 1.21212 ms, enqueue 0.29469 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.635077 ms - Host latency: 0.690033 ms (end to end 1.19725 ms, enqueue 0.294782 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59823 ms - Host latency: 0.653284 ms (end to end 1.18101 ms, enqueue 0.297009 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622388 ms - Host latency: 0.676837 ms (end to end 1.20291 ms, enqueue 0.294885 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610822 ms - Host latency: 0.665625 ms (end to end 1.15104 ms, enqueue 0.298791 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59751 ms - Host latency: 0.652191 ms (end to end 1.17433 ms, enqueue 0.29491 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61286 ms - Host latency: 0.667285 ms (end to end 1.18336 ms, enqueue 0.294537 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594012 ms - Host latency: 0.648737 ms (end to end 1.14474 ms, enqueue 0.293781 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610626 ms - Host latency: 0.665308 ms (end to end 1.17843 ms, enqueue 0.294922 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614093 ms - Host latency: 0.669037 ms (end to end 1.1611 ms, enqueue 0.297162 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598431 ms - Host latency: 0.65307 ms (end to end 1.17574 ms, enqueue 0.293616 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630572 ms - Host latency: 0.685297 ms (end to end 1.21815 ms, enqueue 0.294135 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627203 ms - Host latency: 0.681854 ms (end to end 1.18256 ms, enqueue 0.296863 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59762 ms - Host latency: 0.652179 ms (end to end 1.18406 ms, enqueue 0.294464 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620227 ms - Host latency: 0.674854 ms (end to end 1.1938 ms, enqueue 0.296136 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593213 ms - Host latency: 0.648157 ms (end to end 1.13898 ms, enqueue 0.298938 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613495 ms - Host latency: 0.668121 ms (end to end 1.18134 ms, enqueue 0.296649 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619305 ms - Host latency: 0.673999 ms (end to end 1.1668 ms, enqueue 0.297266 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589307 ms - Host latency: 0.644251 ms (end to end 1.15931 ms, enqueue 0.294281 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617987 ms - Host latency: 0.672772 ms (end to end 1.19191 ms, enqueue 0.296429 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628839 ms - Host latency: 0.683533 ms (end to end 1.18687 ms, enqueue 0.294604 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.607233 ms - Host latency: 0.662152 ms (end to end 1.19583 ms, enqueue 0.296088 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.624139 ms - Host latency: 0.678961 ms (end to end 1.20392 ms, enqueue 0.296661 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597321 ms - Host latency: 0.652216 ms (end to end 1.15298 ms, enqueue 0.295135 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61358 ms - Host latency: 0.668134 ms (end to end 1.18206 ms, enqueue 0.296832 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617371 ms - Host latency: 0.672095 ms (end to end 1.16332 ms, enqueue 0.298767 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593603 ms - Host latency: 0.648175 ms (end to end 1.16573 ms, enqueue 0.294696 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610614 ms - Host latency: 0.665198 ms (end to end 1.17759 ms, enqueue 0.295081 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616565 ms - Host latency: 0.671259 ms (end to end 1.16593 ms, enqueue 0.296838 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.600262 ms - Host latency: 0.656165 ms (end to end 1.17659 ms, enqueue 0.294019 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623639 ms - Host latency: 0.678571 ms (end to end 1.20148 ms, enqueue 0.297711 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627313 ms - Host latency: 0.682141 ms (end to end 1.18312 ms, enqueue 0.294226 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601916 ms - Host latency: 0.657031 ms (end to end 1.188 ms, enqueue 0.297131 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626917 ms - Host latency: 0.681775 ms (end to end 1.20919 ms, enqueue 0.295593 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595337 ms - Host latency: 0.65 ms (end to end 1.14736 ms, enqueue 0.296216 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618372 ms - Host latency: 0.67312 ms (end to end 1.19369 ms, enqueue 0.295435 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614319 ms - Host latency: 0.669348 ms (end to end 1.15918 ms, enqueue 0.298804 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596301 ms - Host latency: 0.651221 ms (end to end 1.16885 ms, enqueue 0.296643 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620203 ms - Host latency: 0.674731 ms (end to end 1.19768 ms, enqueue 0.295007 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611743 ms - Host latency: 0.666724 ms (end to end 1.15645 ms, enqueue 0.296313 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589697 ms - Host latency: 0.644836 ms (end to end 1.15441 ms, enqueue 0.29729 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.633447 ms - Host latency: 0.688501 ms (end to end 1.22131 ms, enqueue 0.29657 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.605981 ms - Host latency: 0.660913 ms (end to end 1.16801 ms, enqueue 0.294604 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627405 ms - Host latency: 0.682373 ms (end to end 1.20789 ms, enqueue 0.296667 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617065 ms - Host latency: 0.671741 ms (end to end 1.16768 ms, enqueue 0.296216 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.590247 ms - Host latency: 0.644971 ms (end to end 1.16084 ms, enqueue 0.292139 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618201 ms - Host latency: 0.672949 ms (end to end 1.19055 ms, enqueue 0.297131 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619092 ms - Host latency: 0.673755 ms (end to end 1.16407 ms, enqueue 0.298938 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596582 ms - Host latency: 0.651392 ms (end to end 1.17439 ms, enqueue 0.294092 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61698 ms - Host latency: 0.671191 ms (end to end 1.19564 ms, enqueue 0.292981 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589185 ms - Host latency: 0.644263 ms (end to end 1.13225 ms, enqueue 0.296985 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623438 ms - Host latency: 0.678345 ms (end to end 1.2032 ms, enqueue 0.295325 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.632812 ms - Host latency: 0.687512 ms (end to end 1.19104 ms, enqueue 0.29657 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.6021 ms - Host latency: 0.657385 ms (end to end 1.18702 ms, enqueue 0.298694 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614807 ms - Host latency: 0.669141 ms (end to end 1.18779 ms, enqueue 0.294226 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614124 ms - Host latency: 0.669019 ms (end to end 1.15471 ms, enqueue 0.298352 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596655 ms - Host latency: 0.651355 ms (end to end 1.17452 ms, enqueue 0.293823 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616943 ms - Host latency: 0.671423 ms (end to end 1.18938 ms, enqueue 0.296509 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592346 ms - Host latency: 0.647119 ms (end to end 1.13635 ms, enqueue 0.298572 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616431 ms - Host latency: 0.67063 ms (end to end 1.20079 ms, enqueue 0.287219 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613965 ms - Host latency: 0.669922 ms (end to end 1.15886 ms, enqueue 0.298218 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596594 ms - Host latency: 0.652588 ms (end to end 1.16399 ms, enqueue 0.297778 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628943 ms - Host latency: 0.684143 ms (end to end 1.20586 ms, enqueue 0.300574 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.629785 ms - Host latency: 0.684766 ms (end to end 1.18585 ms, enqueue 0.297205 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598022 ms - Host latency: 0.65426 ms (end to end 1.16602 ms, enqueue 0.297656 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613452 ms - Host latency: 0.66936 ms (end to end 1.1788 ms, enqueue 0.297913 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.624524 ms - Host latency: 0.679334 ms (end to end 1.17749 ms, enqueue 0.296997 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593933 ms - Host latency: 0.648816 ms (end to end 1.16447 ms, enqueue 0.296997 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61001 ms - Host latency: 0.664551 ms (end to end 1.17772 ms, enqueue 0.294702 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592505 ms - Host latency: 0.647083 ms (end to end 1.1429 ms, enqueue 0.293958 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619959 ms - Host latency: 0.674841 ms (end to end 1.18929 ms, enqueue 0.29624 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620508 ms - Host latency: 0.675452 ms (end to end 1.16647 ms, enqueue 0.296497 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602649 ms - Host latency: 0.657544 ms (end to end 1.19215 ms, enqueue 0.294458 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.6276 ms - Host latency: 0.682568 ms (end to end 1.20864 ms, enqueue 0.296326 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628101 ms - Host latency: 0.682874 ms (end to end 1.18639 ms, enqueue 0.295557 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593921 ms - Host latency: 0.648572 ms (end to end 1.17014 ms, enqueue 0.294519 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619214 ms - Host latency: 0.673853 ms (end to end 1.19768 ms, enqueue 0.294421 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59259 ms - Host latency: 0.647412 ms (end to end 1.13284 ms, enqueue 0.298914 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621668 ms - Host latency: 0.676099 ms (end to end 1.19883 ms, enqueue 0.29624 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614429 ms - Host latency: 0.668774 ms (end to end 1.16519 ms, enqueue 0.293982 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.590515 ms - Host latency: 0.64552 ms (end to end 1.15416 ms, enqueue 0.295593 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619202 ms - Host latency: 0.674365 ms (end to end 1.19246 ms, enqueue 0.296436 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630774 ms - Host latency: 0.685425 ms (end to end 1.19111 ms, enqueue 0.294775 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598328 ms - Host latency: 0.653308 ms (end to end 1.18112 ms, enqueue 0.293909 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.632629 ms - Host latency: 0.687634 ms (end to end 1.21899 ms, enqueue 0.295898 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592786 ms - Host latency: 0.647436 ms (end to end 1.1391 ms, enqueue 0.295935 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614526 ms - Host latency: 0.66875 ms (end to end 1.19 ms, enqueue 0.29187 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617883 ms - Host latency: 0.672644 ms (end to end 1.17292 ms, enqueue 0.293811 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592566 ms - Host latency: 0.647229 ms (end to end 1.15851 ms, enqueue 0.298791 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611011 ms - Host latency: 0.665698 ms (end to end 1.17767 ms, enqueue 0.292981 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618884 ms - Host latency: 0.673425 ms (end to end 1.16605 ms, enqueue 0.296143 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596594 ms - Host latency: 0.651343 ms (end to end 1.17501 ms, enqueue 0.295544 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622681 ms - Host latency: 0.677539 ms (end to end 1.20123 ms, enqueue 0.296118 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.606348 ms - Host latency: 0.661023 ms (end to end 1.17073 ms, enqueue 0.29386 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625757 ms - Host latency: 0.680652 ms (end to end 1.20276 ms, enqueue 0.298132 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626697 ms - Host latency: 0.681396 ms (end to end 1.18247 ms, enqueue 0.296326 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589819 ms - Host latency: 0.64458 ms (end to end 1.16044 ms, enqueue 0.295715 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614539 ms - Host latency: 0.66897 ms (end to end 1.18937 ms, enqueue 0.292126 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614307 ms - Host latency: 0.669067 ms (end to end 1.16125 ms, enqueue 0.296411 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.599072 ms - Host latency: 0.653918 ms (end to end 1.17301 ms, enqueue 0.296167 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616858 ms - Host latency: 0.671472 ms (end to end 1.18882 ms, enqueue 0.29646 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614185 ms - Host latency: 0.668958 ms (end to end 1.16095 ms, enqueue 0.293738 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593616 ms - Host latency: 0.648364 ms (end to end 1.16597 ms, enqueue 0.296619 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598157 ms - Host latency: 0.653088 ms (end to end 1.18014 ms, enqueue 0.294141 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601062 ms - Host latency: 0.656226 ms (end to end 1.17705 ms, enqueue 0.298206 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626489 ms - Host latency: 0.681006 ms (end to end 1.21007 ms, enqueue 0.294824 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619934 ms - Host latency: 0.67467 ms (end to end 1.16539 ms, enqueue 0.298083 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594556 ms - Host latency: 0.649133 ms (end to end 1.17186 ms, enqueue 0.293494 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613684 ms - Host latency: 0.668237 ms (end to end 1.18441 ms, enqueue 0.293726 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.615002 ms - Host latency: 0.66969 ms (end to end 1.16207 ms, enqueue 0.29635 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594128 ms - Host latency: 0.64873 ms (end to end 1.16718 ms, enqueue 0.293774 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.62251 ms - Host latency: 0.6771 ms (end to end 1.20469 ms, enqueue 0.292505 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592053 ms - Host latency: 0.647412 ms (end to end 1.13695 ms, enqueue 0.296472 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626672 ms - Host latency: 0.681238 ms (end to end 1.21 ms, enqueue 0.293689 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631628 ms - Host latency: 0.686877 ms (end to end 1.18352 ms, enqueue 0.2979 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616431 ms - Host latency: 0.675024 ms (end to end 1.21747 ms, enqueue 0.296021 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618103 ms - Host latency: 0.672534 ms (end to end 1.19203 ms, enqueue 0.295947 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613696 ms - Host latency: 0.668323 ms (end to end 1.16412 ms, enqueue 0.294312 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596899 ms - Host latency: 0.651697 ms (end to end 1.16884 ms, enqueue 0.296545 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618384 ms - Host latency: 0.672961 ms (end to end 1.19078 ms, enqueue 0.295667 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595569 ms - Host latency: 0.650098 ms (end to end 1.15193 ms, enqueue 0.292224 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613696 ms - Host latency: 0.668408 ms (end to end 1.18184 ms, enqueue 0.296204 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617468 ms - Host latency: 0.672046 ms (end to end 1.17352 ms, enqueue 0.293579 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601916 ms - Host latency: 0.657141 ms (end to end 1.17771 ms, enqueue 0.29613 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.635303 ms - Host latency: 0.689978 ms (end to end 1.22706 ms, enqueue 0.293896 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627405 ms - Host latency: 0.682239 ms (end to end 1.18571 ms, enqueue 0.29425 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.5979 ms - Host latency: 0.652039 ms (end to end 1.18124 ms, enqueue 0.293896 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617371 ms - Host latency: 0.672376 ms (end to end 1.18546 ms, enqueue 0.297461 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621265 ms - Host latency: 0.675903 ms (end to end 1.17566 ms, enqueue 0.29375 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593628 ms - Host latency: 0.648071 ms (end to end 1.17025 ms, enqueue 0.29502 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610583 ms - Host latency: 0.665222 ms (end to end 1.17584 ms, enqueue 0.29574 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595764 ms - Host latency: 0.650476 ms (end to end 1.14697 ms, enqueue 0.29646 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614343 ms - Host latency: 0.669092 ms (end to end 1.18739 ms, enqueue 0.295007 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623706 ms - Host latency: 0.678455 ms (end to end 1.17814 ms, enqueue 0.293872 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.605701 ms - Host latency: 0.66062 ms (end to end 1.19213 ms, enqueue 0.29541 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626709 ms - Host latency: 0.68186 ms (end to end 1.20708 ms, enqueue 0.295801 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622363 ms - Host latency: 0.676794 ms (end to end 1.17644 ms, enqueue 0.29425 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593201 ms - Host latency: 0.648071 ms (end to end 1.16466 ms, enqueue 0.29707 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618481 ms - Host latency: 0.673303 ms (end to end 1.18667 ms, enqueue 0.297827 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593213 ms - Host latency: 0.647974 ms (end to end 1.14066 ms, enqueue 0.296313 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613684 ms - Host latency: 0.66853 ms (end to end 1.18477 ms, enqueue 0.293921 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617895 ms - Host latency: 0.67251 ms (end to end 1.16589 ms, enqueue 0.296985 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.590247 ms - Host latency: 0.645581 ms (end to end 1.16052 ms, enqueue 0.295715 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621582 ms - Host latency: 0.676624 ms (end to end 1.19692 ms, enqueue 0.295911 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627795 ms - Host latency: 0.682459 ms (end to end 1.18527 ms, enqueue 0.291528 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601904 ms - Host latency: 0.65686 ms (end to end 1.18773 ms, enqueue 0.296118 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627026 ms - Host latency: 0.682153 ms (end to end 1.20388 ms, enqueue 0.297229 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593591 ms - Host latency: 0.648108 ms (end to end 1.1476 ms, enqueue 0.292053 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620557 ms - Host latency: 0.675317 ms (end to end 1.19514 ms, enqueue 0.296191 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619299 ms - Host latency: 0.673926 ms (end to end 1.16654 ms, enqueue 0.295081 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595337 ms - Host latency: 0.650098 ms (end to end 1.17177 ms, enqueue 0.296313 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613562 ms - Host latency: 0.668127 ms (end to end 1.18135 ms, enqueue 0.29563 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620654 ms - Host latency: 0.675598 ms (end to end 1.17241 ms, enqueue 0.296997 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597473 ms - Host latency: 0.652161 ms (end to end 1.17556 ms, enqueue 0.293469 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623328 ms - Host latency: 0.678552 ms (end to end 1.19963 ms, enqueue 0.295825 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627393 ms - Host latency: 0.682336 ms (end to end 1.18031 ms, enqueue 0.29624 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.605103 ms - Host latency: 0.659631 ms (end to end 1.20084 ms, enqueue 0.292444 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614001 ms - Host latency: 0.668408 ms (end to end 1.18119 ms, enqueue 0.295361 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593091 ms - Host latency: 0.647644 ms (end to end 1.14065 ms, enqueue 0.29679 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619507 ms - Host latency: 0.674597 ms (end to end 1.19325 ms, enqueue 0.296472 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617261 ms - Host latency: 0.672058 ms (end to end 1.16082 ms, enqueue 0.298047 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594446 ms - Host latency: 0.649158 ms (end to end 1.17338 ms, enqueue 0.291614 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618164 ms - Host latency: 0.67301 ms (end to end 1.18971 ms, enqueue 0.295874 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.615552 ms - Host latency: 0.670776 ms (end to end 1.15642 ms, enqueue 0.298145 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602564 ms - Host latency: 0.657544 ms (end to end 1.18413 ms, enqueue 0.29585 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630493 ms - Host latency: 0.685388 ms (end to end 1.21544 ms, enqueue 0.294397 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.6026 ms - Host latency: 0.657458 ms (end to end 1.16826 ms, enqueue 0.291956 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617871 ms - Host latency: 0.672754 ms (end to end 1.1871 ms, enqueue 0.298438 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617554 ms - Host latency: 0.672485 ms (end to end 1.16582 ms, enqueue 0.295947 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597192 ms - Host latency: 0.651355 ms (end to end 1.17476 ms, enqueue 0.293591 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618616 ms - Host latency: 0.673083 ms (end to end 1.19445 ms, enqueue 0.293823 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613464 ms - Host latency: 0.668066 ms (end to end 1.16058 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593298 ms - Host latency: 0.648096 ms (end to end 1.16396 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619812 ms - Host latency: 0.674658 ms (end to end 1.19431 ms, enqueue 0.29707 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596692 ms - Host latency: 0.651855 ms (end to end 1.14637 ms, enqueue 0.295508 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628137 ms - Host latency: 0.682739 ms (end to end 1.2136 ms, enqueue 0.294141 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631592 ms - Host latency: 0.686707 ms (end to end 1.18759 ms, enqueue 0.295996 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597498 ms - Host latency: 0.652356 ms (end to end 1.17946 ms, enqueue 0.295264 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610791 ms - Host latency: 0.665479 ms (end to end 1.17598 ms, enqueue 0.296814 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613391 ms - Host latency: 0.66803 ms (end to end 1.16066 ms, enqueue 0.295557 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.594519 ms - Host latency: 0.649451 ms (end to end 1.16429 ms, enqueue 0.296497 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610388 ms - Host latency: 0.665173 ms (end to end 1.17887 ms, enqueue 0.294141 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593921 ms - Host latency: 0.648438 ms (end to end 1.14266 ms, enqueue 0.296948 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614185 ms - Host latency: 0.669092 ms (end to end 1.18132 ms, enqueue 0.296204 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.624744 ms - Host latency: 0.679321 ms (end to end 1.17567 ms, enqueue 0.296082 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59884 ms - Host latency: 0.65376 ms (end to end 1.18419 ms, enqueue 0.293811 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.631396 ms - Host latency: 0.68623 ms (end to end 1.21709 ms, enqueue 0.296558 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625256 ms - Host latency: 0.680005 ms (end to end 1.18505 ms, enqueue 0.293518 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588867 ms - Host latency: 0.643103 ms (end to end 1.15753 ms, enqueue 0.294019 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614612 ms - Host latency: 0.669214 ms (end to end 1.18392 ms, enqueue 0.295227 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593225 ms - Host latency: 0.647632 ms (end to end 1.14537 ms, enqueue 0.292053 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613977 ms - Host latency: 0.668213 ms (end to end 1.18881 ms, enqueue 0.291431 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.6224 ms - Host latency: 0.677258 ms (end to end 1.17164 ms, enqueue 0.297583 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59021 ms - Host latency: 0.644824 ms (end to end 1.16482 ms, enqueue 0.294128 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.619299 ms - Host latency: 0.67373 ms (end to end 1.19805 ms, enqueue 0.294141 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626794 ms - Host latency: 0.681836 ms (end to end 1.17933 ms, enqueue 0.298462 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.607629 ms - Host latency: 0.662378 ms (end to end 1.19852 ms, enqueue 0.293921 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.629968 ms - Host latency: 0.684985 ms (end to end 1.2179 ms, enqueue 0.294336 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622363 ms - Host latency: 0.676941 ms (end to end 1.17322 ms, enqueue 0.294861 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589746 ms - Host latency: 0.644629 ms (end to end 1.15706 ms, enqueue 0.296777 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.610229 ms - Host latency: 0.664941 ms (end to end 1.1748 ms, enqueue 0.295459 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595898 ms - Host latency: 0.650488 ms (end to end 1.14692 ms, enqueue 0.296143 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618677 ms - Host latency: 0.673511 ms (end to end 1.19753 ms, enqueue 0.292505 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617407 ms - Host latency: 0.67207 ms (end to end 1.1634 ms, enqueue 0.296216 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596948 ms - Host latency: 0.651929 ms (end to end 1.17429 ms, enqueue 0.296094 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626367 ms - Host latency: 0.681177 ms (end to end 1.20852 ms, enqueue 0.296606 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623047 ms - Host latency: 0.678003 ms (end to end 1.17551 ms, enqueue 0.296094 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602222 ms - Host latency: 0.657324 ms (end to end 1.18171 ms, enqueue 0.295801 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61814 ms - Host latency: 0.672583 ms (end to end 1.19414 ms, enqueue 0.293945 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595386 ms - Host latency: 0.650439 ms (end to end 1.14221 ms, enqueue 0.297754 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614331 ms - Host latency: 0.668921 ms (end to end 1.18501 ms, enqueue 0.294189 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.624365 ms - Host latency: 0.679248 ms (end to end 1.17478 ms, enqueue 0.296606 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595874 ms - Host latency: 0.650781 ms (end to end 1.17297 ms, enqueue 0.297119 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.622925 ms - Host latency: 0.677661 ms (end to end 1.19963 ms, enqueue 0.296021 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617456 ms - Host latency: 0.67229 ms (end to end 1.16946 ms, enqueue 0.292529 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593286 ms - Host latency: 0.6479 ms (end to end 1.16902 ms, enqueue 0.29375 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630786 ms - Host latency: 0.685889 ms (end to end 1.21567 ms, enqueue 0.295923 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627979 ms - Host latency: 0.682739 ms (end to end 1.18174 ms, enqueue 0.297729 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596997 ms - Host latency: 0.65188 ms (end to end 1.17295 ms, enqueue 0.296313 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621313 ms - Host latency: 0.675757 ms (end to end 1.17202 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595044 ms - Host latency: 0.649756 ms (end to end 1.16819 ms, enqueue 0.296362 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.624438 ms - Host latency: 0.679272 ms (end to end 1.20366 ms, enqueue 0.296606 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61748 ms - Host latency: 0.672119 ms (end to end 1.16528 ms, enqueue 0.296289 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589697 ms - Host latency: 0.644238 ms (end to end 1.15864 ms, enqueue 0.295996 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614575 ms - Host latency: 0.669409 ms (end to end 1.18521 ms, enqueue 0.294019 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625391 ms - Host latency: 0.680347 ms (end to end 1.17495 ms, enqueue 0.295728 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598267 ms - Host latency: 0.653345 ms (end to end 1.17957 ms, enqueue 0.296094 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.634937 ms - Host latency: 0.689746 ms (end to end 1.22361 ms, enqueue 0.296143 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602002 ms - Host latency: 0.657031 ms (end to end 1.1584 ms, enqueue 0.296265 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61062 ms - Host latency: 0.66521 ms (end to end 1.17607 ms, enqueue 0.29624 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617456 ms - Host latency: 0.672095 ms (end to end 1.16521 ms, enqueue 0.296582 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596265 ms - Host latency: 0.650903 ms (end to end 1.17573 ms, enqueue 0.29375 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618189 ms - Host latency: 0.6729 ms (end to end 1.19016 ms, enqueue 0.295923 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616406 ms - Host latency: 0.670947 ms (end to end 1.16677 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596973 ms - Host latency: 0.651758 ms (end to end 1.17305 ms, enqueue 0.293408 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618848 ms - Host latency: 0.673633 ms (end to end 1.19426 ms, enqueue 0.294189 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.600513 ms - Host latency: 0.655518 ms (end to end 1.15667 ms, enqueue 0.296802 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628491 ms - Host latency: 0.68335 ms (end to end 1.21184 ms, enqueue 0.29585 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.633789 ms - Host latency: 0.688721 ms (end to end 1.19412 ms, enqueue 0.29436 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592114 ms - Host latency: 0.646704 ms (end to end 1.17056 ms, enqueue 0.29624 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618604 ms - Host latency: 0.673267 ms (end to end 1.19231 ms, enqueue 0.295117 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620361 ms - Host latency: 0.674805 ms (end to end 1.17703 ms, enqueue 0.292236 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597827 ms - Host latency: 0.652417 ms (end to end 1.1761 ms, enqueue 0.295801 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617847 ms - Host latency: 0.6729 ms (end to end 1.18853 ms, enqueue 0.297607 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611963 ms - Host latency: 0.666309 ms (end to end 1.16621 ms, enqueue 0.289868 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.585938 ms - Host latency: 0.640576 ms (end to end 1.15808 ms, enqueue 0.289355 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59187 ms - Host latency: 0.646582 ms (end to end 1.09622 ms, enqueue 0.294043 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593897 ms - Host latency: 0.649194 ms (end to end 1.05732 ms, enqueue 0.294702 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.63313 ms - Host latency: 0.687915 ms (end to end 1.17085 ms, enqueue 0.294116 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.595459 ms - Host latency: 0.650317 ms (end to end 1.1802 ms, enqueue 0.297339 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61355 ms - Host latency: 0.668188 ms (end to end 1.18489 ms, enqueue 0.293994 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.609326 ms - Host latency: 0.66355 ms (end to end 1.15679 ms, enqueue 0.293262 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589331 ms - Host latency: 0.644116 ms (end to end 1.15305 ms, enqueue 0.295972 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613452 ms - Host latency: 0.668359 ms (end to end 1.18196 ms, enqueue 0.294214 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588794 ms - Host latency: 0.643555 ms (end to end 1.13455 ms, enqueue 0.2948 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.605444 ms - Host latency: 0.6604 ms (end to end 1.16719 ms, enqueue 0.293799 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612061 ms - Host latency: 0.667017 ms (end to end 1.1531 ms, enqueue 0.295996 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593311 ms - Host latency: 0.648096 ms (end to end 1.17112 ms, enqueue 0.292017 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625854 ms - Host latency: 0.68064 ms (end to end 1.2073 ms, enqueue 0.29585 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593481 ms - Host latency: 0.648608 ms (end to end 1.13989 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.60542 ms - Host latency: 0.660034 ms (end to end 1.16775 ms, enqueue 0.293628 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611133 ms - Host latency: 0.665845 ms (end to end 1.15212 ms, enqueue 0.296216 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584253 ms - Host latency: 0.638989 ms (end to end 1.149 ms, enqueue 0.292798 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.618115 ms - Host latency: 0.672461 ms (end to end 1.19558 ms, enqueue 0.292261 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584717 ms - Host latency: 0.639551 ms (end to end 1.127 ms, enqueue 0.294385 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.615552 ms - Host latency: 0.67019 ms (end to end 1.18643 ms, enqueue 0.295947 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612598 ms - Host latency: 0.667554 ms (end to end 1.1584 ms, enqueue 0.294067 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.598511 ms - Host latency: 0.654443 ms (end to end 1.17747 ms, enqueue 0.293188 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625513 ms - Host latency: 0.680591 ms (end to end 1.20701 ms, enqueue 0.296289 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.597095 ms - Host latency: 0.652319 ms (end to end 1.14724 ms, enqueue 0.296118 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.609033 ms - Host latency: 0.663843 ms (end to end 1.17241 ms, enqueue 0.295605 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613599 ms - Host latency: 0.668286 ms (end to end 1.15803 ms, enqueue 0.294531 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601245 ms - Host latency: 0.65603 ms (end to end 1.18335 ms, enqueue 0.296216 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612695 ms - Host latency: 0.667554 ms (end to end 1.17625 ms, enqueue 0.299048 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614014 ms - Host latency: 0.668555 ms (end to end 1.16108 ms, enqueue 0.293359 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587573 ms - Host latency: 0.642261 ms (end to end 1.14565 ms, enqueue 0.295605 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613281 ms - Host latency: 0.668506 ms (end to end 1.15959 ms, enqueue 0.295874 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.591821 ms - Host latency: 0.646997 ms (end to end 1.15833 ms, enqueue 0.296899 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623438 ms - Host latency: 0.678345 ms (end to end 1.20466 ms, enqueue 0.294092 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.630078 ms - Host latency: 0.685156 ms (end to end 1.1833 ms, enqueue 0.298511 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588843 ms - Host latency: 0.643677 ms (end to end 1.16077 ms, enqueue 0.297192 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.606152 ms - Host latency: 0.660913 ms (end to end 1.16809 ms, enqueue 0.296899 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587964 ms - Host latency: 0.6427 ms (end to end 1.13164 ms, enqueue 0.296997 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.607031 ms - Host latency: 0.661035 ms (end to end 1.19128 ms, enqueue 0.281226 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613672 ms - Host latency: 0.66897 ms (end to end 1.17354 ms, enqueue 0.285132 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588696 ms - Host latency: 0.643677 ms (end to end 1.16509 ms, enqueue 0.287622 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61001 ms - Host latency: 0.664844 ms (end to end 1.17485 ms, enqueue 0.295605 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584521 ms - Host latency: 0.639722 ms (end to end 1.12524 ms, enqueue 0.29353 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623242 ms - Host latency: 0.679321 ms (end to end 1.19739 ms, enqueue 0.298853 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.625391 ms - Host latency: 0.681079 ms (end to end 1.18193 ms, enqueue 0.295703 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.602832 ms - Host latency: 0.657788 ms (end to end 1.18738 ms, enqueue 0.294946 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.616284 ms - Host latency: 0.670947 ms (end to end 1.18838 ms, enqueue 0.295093 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.585498 ms - Host latency: 0.640161 ms (end to end 1.12664 ms, enqueue 0.297314 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.609497 ms - Host latency: 0.664282 ms (end to end 1.17659 ms, enqueue 0.294238 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.60835 ms - Host latency: 0.663037 ms (end to end 1.14607 ms, enqueue 0.297021 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589307 ms - Host latency: 0.643823 ms (end to end 1.16365 ms, enqueue 0.291553 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612402 ms - Host latency: 0.66748 ms (end to end 1.17466 ms, enqueue 0.299243 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.592163 ms - Host latency: 0.647144 ms (end to end 1.14377 ms, enqueue 0.293506 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617163 ms - Host latency: 0.67229 ms (end to end 1.18711 ms, enqueue 0.296997 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.621875 ms - Host latency: 0.676562 ms (end to end 1.179 ms, enqueue 0.294653 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.603271 ms - Host latency: 0.659473 ms (end to end 1.18516 ms, enqueue 0.297046 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61648 ms - Host latency: 0.670972 ms (end to end 1.18809 ms, enqueue 0.296094 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.606177 ms - Host latency: 0.66062 ms (end to end 1.14934 ms, enqueue 0.295142 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584399 ms - Host latency: 0.639355 ms (end to end 1.1436 ms, enqueue 0.296558 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611426 ms - Host latency: 0.666089 ms (end to end 1.15095 ms, enqueue 0.296851 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584424 ms - Host latency: 0.639063 ms (end to end 1.15298 ms, enqueue 0.293872 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.608862 ms - Host latency: 0.663257 ms (end to end 1.17949 ms, enqueue 0.293213 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612744 ms - Host latency: 0.667895 ms (end to end 1.15676 ms, enqueue 0.295679 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.59646 ms - Host latency: 0.651514 ms (end to end 1.1697 ms, enqueue 0.297046 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.628833 ms - Host latency: 0.683862 ms (end to end 1.18135 ms, enqueue 0.296948 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596973 ms - Host latency: 0.651538 ms (end to end 1.19429 ms, enqueue 0.286499 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617969 ms - Host latency: 0.672681 ms (end to end 1.19092 ms, enqueue 0.296582 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612183 ms - Host latency: 0.666821 ms (end to end 1.15925 ms, enqueue 0.293433 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.590112 ms - Host latency: 0.644605 ms (end to end 1.16001 ms, enqueue 0.294653 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.608594 ms - Host latency: 0.663428 ms (end to end 1.17046 ms, enqueue 0.295801 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.584985 ms - Host latency: 0.639868 ms (end to end 1.12668 ms, enqueue 0.295435 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.614087 ms - Host latency: 0.668774 ms (end to end 1.18357 ms, enqueue 0.295825 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612549 ms - Host latency: 0.667432 ms (end to end 1.16035 ms, enqueue 0.294946 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.586841 ms - Host latency: 0.641943 ms (end to end 1.14854 ms, enqueue 0.29668 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.629077 ms - Host latency: 0.683813 ms (end to end 1.21389 ms, enqueue 0.296802 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596484 ms - Host latency: 0.65188 ms (end to end 1.14221 ms, enqueue 0.298584 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.627637 ms - Host latency: 0.682861 ms (end to end 1.2095 ms, enqueue 0.296631 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61189 ms - Host latency: 0.666455 ms (end to end 1.15562 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589624 ms - Host latency: 0.644678 ms (end to end 1.16245 ms, enqueue 0.29458 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611865 ms - Host latency: 0.666211 ms (end to end 1.18828 ms, enqueue 0.289893 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.588037 ms - Host latency: 0.642554 ms (end to end 1.13293 ms, enqueue 0.293701 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613672 ms - Host latency: 0.668066 ms (end to end 1.18689 ms, enqueue 0.294531 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.615991 ms - Host latency: 0.670923 ms (end to end 1.15715 ms, enqueue 0.298804 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.586987 ms - Host latency: 0.641797 ms (end to end 1.15535 ms, enqueue 0.296509 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61792 ms - Host latency: 0.672632 ms (end to end 1.19329 ms, enqueue 0.29458 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.620923 ms - Host latency: 0.675952 ms (end to end 1.17188 ms, enqueue 0.293848 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.601636 ms - Host latency: 0.656958 ms (end to end 1.18359 ms, enqueue 0.296802 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617334 ms - Host latency: 0.671899 ms (end to end 1.17275 ms, enqueue 0.295044 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.590942 ms - Host latency: 0.645703 ms (end to end 1.15356 ms, enqueue 0.298804 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.61311 ms - Host latency: 0.667676 ms (end to end 1.18103 ms, enqueue 0.295679 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612378 ms - Host latency: 0.667017 ms (end to end 1.15713 ms, enqueue 0.294678 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587549 ms - Host latency: 0.642236 ms (end to end 1.15352 ms, enqueue 0.296631 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.623022 ms - Host latency: 0.68064 ms (end to end 1.20063 ms, enqueue 0.29646 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587817 ms - Host latency: 0.642725 ms (end to end 1.13232 ms, enqueue 0.295264 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.607031 ms - Host latency: 0.662036 ms (end to end 1.16787 ms, enqueue 0.296338 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.550415 ms - Host latency: 0.611792 ms (end to end 1.04468 ms, enqueue 0.298828 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.543579 ms - Host latency: 0.602344 ms (end to end 1.04727 ms, enqueue 0.296924 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.609863 ms - Host latency: 0.673389 ms (end to end 1.15 ms, enqueue 0.307471 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.551782 ms - Host latency: 0.615039 ms (end to end 1.06123 ms, enqueue 0.30105 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.542798 ms - Host latency: 0.599414 ms (end to end 1.03464 ms, enqueue 0.30332 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.579053 ms - Host latency: 0.644897 ms (end to end 1.08718 ms, enqueue 0.305029 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.579077 ms - Host latency: 0.636279 ms (end to end 1.11733 ms, enqueue 0.294263 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.55144 ms - Host latency: 0.613135 ms (end to end 1.03147 ms, enqueue 0.308472 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.572266 ms - Host latency: 0.635962 ms (end to end 1.07034 ms, enqueue 0.30769 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.579224 ms - Host latency: 0.634131 ms (end to end 1.13772 ms, enqueue 0.301416 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.553857 ms - Host latency: 0.619092 ms (end to end 1.07493 ms, enqueue 0.297314 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.553271 ms - Host latency: 0.616455 ms (end to end 1.08645 ms, enqueue 0.277661 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.799536 ms - Host latency: 0.855444 ms (end to end 1.55374 ms, enqueue 0.290649 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.26353 ms - Host latency: 1.31941 ms (end to end 2.48318 ms, enqueue 0.295581 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.01338 ms - Host latency: 1.06877 ms (end to end 1.97871 ms, enqueue 0.297266 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.25088 ms - Host latency: 1.30615 ms (end to end 2.45352 ms, enqueue 0.296191 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.25483 ms - Host latency: 1.31001 ms (end to end 2.22197 ms, enqueue 0.298242 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.01599 ms - Host latency: 1.07085 ms (end to end 2.22317 ms, enqueue 0.295728 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.25706 ms - Host latency: 1.3124 ms (end to end 2.46563 ms, enqueue 0.296802 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.01533 ms - Host latency: 1.07043 ms (end to end 1.98198 ms, enqueue 0.296436 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 1.13594 ms - Host latency: 1.19082 ms (end to end 2.22756 ms, enqueue 0.295239 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.633032 ms - Host latency: 0.688208 ms (end to end 1.18145 ms, enqueue 0.297607 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.596826 ms - Host latency: 0.652026 ms (end to end 1.18394 ms, enqueue 0.298413 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626172 ms - Host latency: 0.681006 ms (end to end 1.20996 ms, enqueue 0.294409 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612378 ms - Host latency: 0.66665 ms (end to end 1.15742 ms, enqueue 0.295337 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.591138 ms - Host latency: 0.646118 ms (end to end 1.15601 ms, enqueue 0.29873 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612305 ms - Host latency: 0.666699 ms (end to end 1.18433 ms, enqueue 0.2948 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.589893 ms - Host latency: 0.644238 ms (end to end 1.13711 ms, enqueue 0.29458 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.611499 ms - Host latency: 0.666382 ms (end to end 1.17654 ms, enqueue 0.296582 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.612231 ms - Host latency: 0.667017 ms (end to end 1.15977 ms, enqueue 0.295435 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587891 ms - Host latency: 0.642944 ms (end to end 1.15178 ms, enqueue 0.296973 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.617407 ms - Host latency: 0.671899 ms (end to end 1.19412 ms, enqueue 0.292944 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.593603 ms - Host latency: 0.648438 ms (end to end 1.14468 ms, enqueue 0.296265 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.626245 ms - Host latency: 0.68103 ms (end to end 1.20762 ms, enqueue 0.297656 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613452 ms - Host latency: 0.668188 ms (end to end 1.16167 ms, enqueue 0.297095 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.58501 ms - Host latency: 0.639819 ms (end to end 1.14617 ms, enqueue 0.296924 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.613281 ms - Host latency: 0.667822 ms (end to end 1.17991 ms, enqueue 0.296021 ms)
[05/21/2021-07:45:19] [I] Average on 10 runs - GPU latency: 0.587622 ms - Host latency: 0.642383 ms (end to end 1.12969 ms, enqueue 0.296948 ms)
[05/21/2021-07:45:19] [I] 
[05/21/2021-07:45:19] [I] === Performance summary ===
[05/21/2021-07:45:19] [I] Throughput: 1605.38 qps
[05/21/2021-07:45:19] [I] Latency: min = 0.59375 ms, max = 3.03711 ms, mean = 0.67339 ms, median = 0.602051 ms, percentile(99%) = 0.905029 ms
[05/21/2021-07:45:19] [I] End-to-End Host Latency: min = 0.707031 ms, max = 3.47461 ms, mean = 1.19194 ms, median = 1.24438 ms, percentile(99%) = 1.43042 ms
[05/21/2021-07:45:19] [I] Enqueue Time: min = 0.271729 ms, max = 0.454468 ms, mean = 0.295924 ms, median = 0.297974 ms, percentile(99%) = 0.306763 ms
[05/21/2021-07:45:19] [I] H2D Latency: min = 0.0487061 ms, max = 0.102051 ms, mean = 0.0515519 ms, median = 0.0515137 ms, percentile(99%) = 0.0538025 ms
[05/21/2021-07:45:19] [I] GPU Compute Time: min = 0.539551 ms, max = 2.98193 ms, mean = 0.618384 ms, median = 0.546875 ms, percentile(99%) = 0.849915 ms
[05/21/2021-07:45:19] [I] D2H Latency: min = 0.00256348 ms, max = 0.0334473 ms, mean = 0.00346163 ms, median = 0.0032959 ms, percentile(99%) = 0.00448608 ms
[05/21/2021-07:45:19] [I] Total Host Walltime: 3.00179 s
[05/21/2021-07:45:19] [I] Total GPU Compute Time: 2.97999 s
[05/21/2021-07:45:19] [I] Explanations of the performance metrics are printed in the verbose logs.
[05/21/2021-07:45:19] [V] 
[05/21/2021-07:45:19] [V] === Explanations of the performance metrics ===
[05/21/2021-07:45:19] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed.
[05/21/2021-07:45:19] [V] GPU Compute Time: the GPU latency to execute the kernels for a query.
[05/21/2021-07:45:19] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers.
[05/21/2021-07:45:19] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers.
[05/21/2021-07:45:19] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized.
[05/21/2021-07:45:19] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query.
[05/21/2021-07:45:19] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query.
[05/21/2021-07:45:19] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query.
[05/21/2021-07:45:19] [V] End-to-End Host Latency: the duration from when the H2D of a query is called to when the D2H of the same query is completed, which includes the latency to wait for the completion of the previous query. This is the latency of a query if multiple queries are enqueued consecutively.
[05/21/2021-07:45:19] [I] 
[05/21/2021-07:45:23] [I] 
[05/21/2021-07:45:23] [I] === Profile (3326 iterations ) ===
[05/21/2021-07:45:23] [I]                                                                               Layer   Time (ms)   Avg. Time (ms)   Time %
[05/21/2021-07:45:23] [I]                                                                               cast0       18.55           0.0056      0.8
[05/21/2021-07:45:23] [I]                                                                             bn_data       18.65           0.0056      0.8
[05/21/2021-07:45:23] [I]                                                                       conv0 + relu0       81.57           0.0245      3.5
[05/21/2021-07:45:23] [I]                                                                            pooling0       16.70           0.0050      0.7
[05/21/2021-07:45:23] [I]                                               stage1_unit1_bn1 + stage1_unit1_relu1       17.87           0.0054      0.8
[05/21/2021-07:45:23] [I]  Reformatting CopyNode for Output Tensor 0 to stage1_unit1_bn1 + stage1_unit1_relu1       14.04           0.0042      0.6
[05/21/2021-07:45:23] [I]                                             stage1_unit1_conv1 + stage1_unit1_relu2       20.33           0.0061      0.9
[05/21/2021-07:45:23] [I]                                             stage1_unit1_conv2 + stage1_unit1_relu3       30.59           0.0092      1.3
[05/21/2021-07:45:23] [I]                                                                  stage1_unit1_conv3       25.09           0.0075      1.1
[05/21/2021-07:45:23] [I]                                                            stage1_unit1_sc + _plus0       31.53           0.0095      1.4
[05/21/2021-07:45:23] [I]                                               stage1_unit2_bn1 + stage1_unit2_relu1       29.51           0.0089      1.3
[05/21/2021-07:45:23] [I]                                             stage1_unit2_conv1 + stage1_unit2_relu2       24.68           0.0074      1.1
[05/21/2021-07:45:23] [I]                                             stage1_unit2_conv2 + stage1_unit2_relu3       31.80           0.0096      1.4
[05/21/2021-07:45:23] [I]                                                         stage1_unit2_conv3 + _plus1       29.35           0.0088      1.3
[05/21/2021-07:45:23] [I]                                               stage1_unit3_bn1 + stage1_unit3_relu1       29.52           0.0089      1.3
[05/21/2021-07:45:23] [I]                                             stage1_unit3_conv1 + stage1_unit3_relu2       21.96           0.0066      0.9
[05/21/2021-07:45:23] [I]                                             stage1_unit3_conv2 + stage1_unit3_relu3       31.59           0.0095      1.4
[05/21/2021-07:45:23] [I]                                                         stage1_unit3_conv3 + _plus2       29.62           0.0089      1.3
[05/21/2021-07:45:23] [I]                                               stage2_unit1_bn1 + stage2_unit1_relu1       28.48           0.0086      1.2
[05/21/2021-07:45:23] [I]                                             stage2_unit1_conv1 + stage2_unit1_relu2       30.15           0.0091      1.3
[05/21/2021-07:45:23] [I]                                             stage2_unit1_conv2 + stage2_unit1_relu3       35.00           0.0105      1.5
[05/21/2021-07:45:23] [I]                                                                  stage2_unit1_conv3       22.48           0.0068      1.0
[05/21/2021-07:45:23] [I]                                                            stage2_unit1_sc + _plus3       32.72           0.0098      1.4
[05/21/2021-07:45:23] [I]                                               stage2_unit2_bn1 + stage2_unit2_relu1       22.28           0.0067      1.0
[05/21/2021-07:45:23] [I]                                             stage2_unit2_conv1 + stage2_unit2_relu2       25.89           0.0078      1.1
[05/21/2021-07:45:23] [I]                                             stage2_unit2_conv2 + stage2_unit2_relu3       33.13           0.0100      1.4
[05/21/2021-07:45:23] [I]                                                         stage2_unit2_conv3 + _plus4       26.08           0.0078      1.1
[05/21/2021-07:45:23] [I]                                               stage2_unit3_bn1 + stage2_unit3_relu1       22.28           0.0067      1.0
[05/21/2021-07:45:23] [I]                                             stage2_unit3_conv1 + stage2_unit3_relu2       25.33           0.0076      1.1
[05/21/2021-07:45:23] [I]                                             stage2_unit3_conv2 + stage2_unit3_relu3       33.13           0.0100      1.4
[05/21/2021-07:45:23] [I]                                                         stage2_unit3_conv3 + _plus5       25.17           0.0076      1.1
[05/21/2021-07:45:23] [I]                                               stage2_unit4_bn1 + stage2_unit4_relu1       22.20           0.0067      1.0
[05/21/2021-07:45:23] [I]                                             stage2_unit4_conv1 + stage2_unit4_relu2       25.41           0.0076      1.1
[05/21/2021-07:45:23] [I]                                             stage2_unit4_conv2 + stage2_unit4_relu3       33.27           0.0100      1.4
[05/21/2021-07:45:23] [I]                                                         stage2_unit4_conv3 + _plus6       25.06           0.0075      1.1
[05/21/2021-07:45:23] [I]                                               stage3_unit1_bn1 + stage3_unit1_relu1       22.15           0.0067      0.9
[05/21/2021-07:45:23] [I]                                             stage3_unit1_conv1 + stage3_unit1_relu2       27.49           0.0083      1.2
[05/21/2021-07:45:23] [I]                                             stage3_unit1_conv2 + stage3_unit1_relu3       44.82           0.0135      1.9
[05/21/2021-07:45:23] [I]                                                                  stage3_unit1_conv3       22.52           0.0068      1.0
[05/21/2021-07:45:23] [I]                                                            stage3_unit1_sc + _plus7       31.28           0.0094      1.3
[05/21/2021-07:45:23] [I]                                               stage3_unit2_bn1 + stage3_unit2_relu1       19.75           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage3_unit2_conv1 + stage3_unit2_relu2       31.03           0.0093      1.3
[05/21/2021-07:45:23] [I]                                             stage3_unit2_conv2 + stage3_unit2_relu3       43.75           0.0132      1.9
[05/21/2021-07:45:23] [I]                                                         stage3_unit2_conv3 + _plus8       25.94           0.0078      1.1
[05/21/2021-07:45:23] [I]                                               stage3_unit3_bn1 + stage3_unit3_relu1       19.77           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage3_unit3_conv1 + stage3_unit3_relu2       30.36           0.0091      1.3
[05/21/2021-07:45:23] [I]                                             stage3_unit3_conv2 + stage3_unit3_relu3       43.75           0.0132      1.9
[05/21/2021-07:45:23] [I]                                                         stage3_unit3_conv3 + _plus9       24.97           0.0075      1.1
[05/21/2021-07:45:23] [I]                                               stage3_unit4_bn1 + stage3_unit4_relu1       19.66           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage3_unit4_conv1 + stage3_unit4_relu2       30.28           0.0091      1.3
[05/21/2021-07:45:23] [I]                                             stage3_unit4_conv2 + stage3_unit4_relu3       43.77           0.0132      1.9
[05/21/2021-07:45:23] [I]                                                        stage3_unit4_conv3 + _plus10       24.56           0.0074      1.1
[05/21/2021-07:45:23] [I]                                               stage3_unit5_bn1 + stage3_unit5_relu1       19.64           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage3_unit5_conv1 + stage3_unit5_relu2       30.46           0.0092      1.3
[05/21/2021-07:45:23] [I]                                             stage3_unit5_conv2 + stage3_unit5_relu3       43.68           0.0131      1.9
[05/21/2021-07:45:23] [I]                                                        stage3_unit5_conv3 + _plus11       24.93           0.0075      1.1
[05/21/2021-07:45:23] [I]                                               stage3_unit6_bn1 + stage3_unit6_relu1       19.58           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage3_unit6_conv1 + stage3_unit6_relu2       30.29           0.0091      1.3
[05/21/2021-07:45:23] [I]                                             stage3_unit6_conv2 + stage3_unit6_relu3       43.58           0.0131      1.9
[05/21/2021-07:45:23] [I]                                                        stage3_unit6_conv3 + _plus12       24.76           0.0074      1.1
[05/21/2021-07:45:23] [I]                                               stage4_unit1_bn1 + stage4_unit1_relu1       19.63           0.0059      0.8
[05/21/2021-07:45:23] [I]                                             stage4_unit1_conv1 + stage4_unit1_relu2       31.75           0.0095      1.4
[05/21/2021-07:45:23] [I]                                             stage4_unit1_conv2 + stage4_unit1_relu3       66.13           0.0199      2.8
[05/21/2021-07:45:23] [I]                                                                  stage4_unit1_conv3       27.83           0.0084      1.2
[05/21/2021-07:45:23] [I]                                                           stage4_unit1_sc + _plus13       40.44           0.0122      1.7
[05/21/2021-07:45:23] [I]                                               stage4_unit2_bn1 + stage4_unit2_relu1       17.01           0.0051      0.7
[05/21/2021-07:45:23] [I]                                             stage4_unit2_conv1 + stage4_unit2_relu2       45.79           0.0138      2.0
[05/21/2021-07:45:23] [I]                                             stage4_unit2_conv2 + stage4_unit2_relu3       66.25           0.0199      2.8
[05/21/2021-07:45:23] [I]                                                        stage4_unit2_conv3 + _plus14       29.67           0.0089      1.3
[05/21/2021-07:45:23] [I]                                               stage4_unit3_bn1 + stage4_unit3_relu1       18.49           0.0056      0.8
[05/21/2021-07:45:23] [I]                                             stage4_unit3_conv1 + stage4_unit3_relu2       45.67           0.0137      2.0
[05/21/2021-07:45:23] [I]                                             stage4_unit3_conv2 + stage4_unit3_relu3       65.79           0.0198      2.8
[05/21/2021-07:45:23] [I]                                                        stage4_unit3_conv3 + _plus15       29.23           0.0088      1.3
[05/21/2021-07:45:23] [I]                                                                         bn1 + relu1       17.90           0.0054      0.8
[05/21/2021-07:45:23] [I]                                                                               pool1       20.90           0.0063      0.9
[05/21/2021-07:45:23] [I]                                                                                 fc1       46.82           0.0141      2.0
[05/21/2021-07:45:23] [I]          Reformatting CopyNode for Input Tensor 0 to (Unnamed Layer* 176) [Shuffle]       14.39           0.0043      0.6
[05/21/2021-07:45:23] [I]                                                                             softmax       15.38           0.0046      0.7
[05/21/2021-07:45:23] [I]                                                                               Total     2332.86           0.7014    100.0
[05/21/2021-07:45:23] [I] 
&&&& PASSED TensorRT.trtexec [TensorRT v8000] # trtexec --onnx=resnet50-original-symbol.onnx --fp16 --sparsity=force --workspace=8192 --verbose --dumpProfile --separateProfileRun
[05/21/2021-07:45:23] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 2281, GPU 11566 (MiB)