&&&& RUNNING TensorRT.trtexec # ./trtexec_debug --onnx=../samples/sampleSEGNET/APA_FS_Model.onnx --explicitBatch --int8 --verbose [02/03/2021-16:09:15] [I] === Model Options === [02/03/2021-16:09:15] [I] Format: ONNX [02/03/2021-16:09:15] [I] Model: ../samples/sampleSEGNET/APA_FS_Model.onnx [02/03/2021-16:09:15] [I] Output: [02/03/2021-16:09:15] [I] === Build Options === [02/03/2021-16:09:15] [I] Max batch: explicit [02/03/2021-16:09:15] [I] Workspace: 16 MB [02/03/2021-16:09:15] [I] minTiming: 1 [02/03/2021-16:09:15] [I] avgTiming: 8 [02/03/2021-16:09:15] [I] Precision: FP32+INT8 [02/03/2021-16:09:15] [I] Calibration: Dynamic [02/03/2021-16:09:15] [I] Safe mode: Disabled [02/03/2021-16:09:15] [I] Save engine: [02/03/2021-16:09:15] [I] Load engine: [02/03/2021-16:09:15] [I] Builder Cache: Enabled [02/03/2021-16:09:15] [I] NVTX verbosity: 0 [02/03/2021-16:09:15] [I] Inputs format: fp32:CHW [02/03/2021-16:09:15] [I] Outputs format: fp32:CHW [02/03/2021-16:09:15] [I] Input build shapes: model [02/03/2021-16:09:15] [I] Input calibration shapes: model [02/03/2021-16:09:15] [I] === System Options === [02/03/2021-16:09:15] [I] Device: 0 [02/03/2021-16:09:15] [I] DLACore: [02/03/2021-16:09:15] [I] Plugins: [02/03/2021-16:09:15] [I] === Inference Options === [02/03/2021-16:09:15] [I] Batch: Explicit [02/03/2021-16:09:15] [I] Input inference shapes: model [02/03/2021-16:09:15] [I] Iterations: 10 [02/03/2021-16:09:15] [I] Duration: 3s (+ 200ms warm up) [02/03/2021-16:09:15] [I] Sleep time: 0ms [02/03/2021-16:09:15] [I] Streams: 1 [02/03/2021-16:09:15] [I] ExposeDMA: Disabled [02/03/2021-16:09:15] [I] Spin-wait: Disabled [02/03/2021-16:09:15] [I] Multithreading: Disabled [02/03/2021-16:09:15] [I] CUDA Graph: Disabled [02/03/2021-16:09:15] [I] Skip inference: Disabled [02/03/2021-16:09:15] [I] Inputs: [02/03/2021-16:09:15] [I] === Reporting Options === [02/03/2021-16:09:15] [I] Verbose: Enabled [02/03/2021-16:09:15] [I] Averages: 10 inferences [02/03/2021-16:09:15] [I] Percentile: 99 [02/03/2021-16:09:15] [I] Dump output: Disabled [02/03/2021-16:09:15] [I] Profile: Disabled [02/03/2021-16:09:15] [I] Export timing to JSON file: [02/03/2021-16:09:15] [I] Export output to JSON file: [02/03/2021-16:09:15] [I] Export profile to JSON file: [02/03/2021-16:09:15] [I] [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Proposal version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::Split version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [02/03/2021-16:09:15] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 ---------------------------------------------------------------- Input filename: ../samples/sampleSEGNET/APA_FS_Model.onnx ONNX IR version: 0.0.6 Opset version: 9 Producer name: pytorch Producer version: 1.7 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::Split version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (1, 3, 192, 256) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input for ONNX tensor: input [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 228 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 229 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 231 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 232 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 234 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 235 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 237 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 238 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 240 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 241 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 243 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 244 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 246 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 247 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 249 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 250 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 252 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 253 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 255 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 256 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 258 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 259 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 261 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 262 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 264 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 265 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 267 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 268 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 270 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 271 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 273 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 274 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 276 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 277 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 279 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 280 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 282 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 283 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 285 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 286 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Panoptic3_up.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: deconv1.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: deconv2.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: down2/bd.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:90: Importing initializer: down3/bd.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_0 [Constant] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Constant_0 [Constant] inputs: [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Constant_0 [Constant] outputs: [146 -> ()], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: input [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 146 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_1 [Add] inputs: [input -> (1, 3, 192, 256)], [146 -> ()], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_1 for ONNX node: Add_1 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 147 for ONNX tensor: 147 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_1 [Add] outputs: [147 -> (1, 3, 192, 256)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_2 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 147 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 228 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 229 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_2 [Conv] inputs: [147 -> (1, 3, 192, 256)], [228 -> (12, 3, 3, 3)], [229 -> (12)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 192, 256) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_2 for ONNX node: Conv_2 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 12 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 12, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 227 for ONNX tensor: 227 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_2 [Conv] outputs: [227 -> (1, 12, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_3 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 227 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_3 [Relu] inputs: [227 -> (1, 12, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_3 for ONNX node: Relu_3 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 150 for ONNX tensor: 150 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_3 [Relu] outputs: [150 -> (1, 12, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_4 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 150 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 231 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 232 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_4 [Conv] inputs: [150 -> (1, 12, 96, 128)], [231 -> (24, 12, 3, 3)], [232 -> (24)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 12, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_4 for ONNX node: Conv_4 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 230 for ONNX tensor: 230 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_4 [Conv] outputs: [230 -> (1, 24, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_5 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 230 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_5 [Relu] inputs: [230 -> (1, 24, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_5 for ONNX node: Relu_5 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 153 for ONNX tensor: 153 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_5 [Relu] outputs: [153 -> (1, 24, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_6 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 153 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: down2/bd.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_6 [Conv] inputs: [153 -> (1, 24, 96, 128)], [down2/bd.weight -> (24, 1, 3, 3)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_6 for ONNX node: Conv_6 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 154 for ONNX tensor: 154 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_6 [Conv] outputs: [154 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_7 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 154 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 234 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 235 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_7 [Conv] inputs: [154 -> (1, 24, 48, 64)], [234 -> (24, 24, 3, 3)], [235 -> (24)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_7 for ONNX node: Conv_7 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (2, 2), numOutputs: 24 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 233 for ONNX tensor: 233 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_7 [Conv] outputs: [233 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_8 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 233 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_8 [Relu] inputs: [233 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_8 for ONNX node: Relu_8 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 157 for ONNX tensor: 157 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_8 [Relu] outputs: [157 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_9 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 154 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 157 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_9 [Add] inputs: [154 -> (1, 24, 48, 64)], [157 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_9 for ONNX node: Add_9 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 158 for ONNX tensor: 158 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_9 [Add] outputs: [158 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_10 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 158 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 237 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 238 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_10 [Conv] inputs: [158 -> (1, 24, 48, 64)], [237 -> (48, 24, 3, 3)], [238 -> (48)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_10 for ONNX node: Conv_10 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 48 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 236 for ONNX tensor: 236 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_10 [Conv] outputs: [236 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_11 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 236 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_11 [Relu] inputs: [236 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_11 for ONNX node: Relu_11 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 161 for ONNX tensor: 161 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_11 [Relu] outputs: [161 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_12 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 161 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: down3/bd.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_12 [Conv] inputs: [161 -> (1, 48, 48, 64)], [down3/bd.weight -> (48, 1, 3, 3)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_12 for ONNX node: Conv_12 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 48 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 162 for ONNX tensor: 162 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_12 [Conv] outputs: [162 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_13 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 162 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 240 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 241 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_13 [Conv] inputs: [162 -> (1, 48, 24, 32)], [240 -> (48, 12, 3, 3)], [241 -> (48)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_13 for ONNX node: Conv_13 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 48 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 239 for ONNX tensor: 239 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_13 [Conv] outputs: [239 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_14 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 239 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_14 [Relu] inputs: [239 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_14 for ONNX node: Relu_14 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 165 for ONNX tensor: 165 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_14 [Relu] outputs: [165 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_15 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 162 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 165 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_15 [Add] inputs: [162 -> (1, 48, 24, 32)], [165 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_15 for ONNX node: Add_15 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 166 for ONNX tensor: 166 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_15 [Add] outputs: [166 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_16 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 166 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 243 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 244 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_16 [Conv] inputs: [166 -> (1, 48, 24, 32)], [243 -> (64, 48, 3, 3)], [244 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_16 for ONNX node: Conv_16 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 242 for ONNX tensor: 242 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_16 [Conv] outputs: [242 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_17 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 242 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_17 [Relu] inputs: [242 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_17 for ONNX node: Relu_17 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 169 for ONNX tensor: 169 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_17 [Relu] outputs: [169 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_18 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 169 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 246 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 247 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_18 [Conv] inputs: [169 -> (1, 64, 24, 32)], [246 -> (64, 64, 3, 3)], [247 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_18 for ONNX node: Conv_18 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (2, 2), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 245 for ONNX tensor: 245 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_18 [Conv] outputs: [245 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_19 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 245 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_19 [Relu] inputs: [245 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_19 for ONNX node: Relu_19 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 172 for ONNX tensor: 172 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_19 [Relu] outputs: [172 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_20 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 172 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 249 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 250 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_20 [Conv] inputs: [172 -> (1, 64, 24, 32)], [249 -> (64, 64, 3, 3)], [250 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_20 for ONNX node: Conv_20 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 248 for ONNX tensor: 248 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_20 [Conv] outputs: [248 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_21 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 248 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_21 [Relu] inputs: [248 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_21 for ONNX node: Relu_21 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 175 for ONNX tensor: 175 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_21 [Relu] outputs: [175 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_22 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 175 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 172 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_22 [Add] inputs: [175 -> (1, 64, 24, 32)], [172 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_22 for ONNX node: Add_22 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 176 for ONNX tensor: 176 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_22 [Add] outputs: [176 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_23 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 176 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 252 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 253 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_23 [Conv] inputs: [176 -> (1, 64, 24, 32)], [252 -> (64, 64, 3, 3)], [253 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_23 for ONNX node: Conv_23 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (2, 2), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 251 for ONNX tensor: 251 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_23 [Conv] outputs: [251 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_24 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 251 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_24 [Relu] inputs: [251 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_24 for ONNX node: Relu_24 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 179 for ONNX tensor: 179 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_24 [Relu] outputs: [179 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_25 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 179 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 172 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_25 [Add] inputs: [179 -> (1, 64, 24, 32)], [172 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_25 for ONNX node: Add_25 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 180 for ONNX tensor: 180 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_25 [Add] outputs: [180 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_26 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 180 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 255 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 256 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_26 [Conv] inputs: [180 -> (1, 64, 24, 32)], [255 -> (64, 64, 3, 3)], [256 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_26 for ONNX node: Conv_26 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (4, 4), postpadding: (4, 4), dilations: (4, 4), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 254 for ONNX tensor: 254 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_26 [Conv] outputs: [254 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_27 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 254 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_27 [Relu] inputs: [254 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_27 for ONNX node: Relu_27 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 183 for ONNX tensor: 183 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_27 [Relu] outputs: [183 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_28 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 183 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 258 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 259 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_28 [Conv] inputs: [183 -> (1, 64, 24, 32)], [258 -> (64, 64, 3, 3)], [259 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_28 for ONNX node: Conv_28 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 257 for ONNX tensor: 257 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_28 [Conv] outputs: [257 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_29 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 257 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_29 [Relu] inputs: [257 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_29 for ONNX node: Relu_29 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 186 for ONNX tensor: 186 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_29 [Relu] outputs: [186 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_30 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 186 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 183 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_30 [Add] inputs: [186 -> (1, 64, 24, 32)], [183 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_30 for ONNX node: Add_30 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 187 for ONNX tensor: 187 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_30 [Add] outputs: [187 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_31 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 187 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 261 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 262 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_31 [Conv] inputs: [187 -> (1, 64, 24, 32)], [261 -> (64, 64, 3, 3)], [262 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_31 for ONNX node: Conv_31 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (2, 2), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 260 for ONNX tensor: 260 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_31 [Conv] outputs: [260 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_32 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 260 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_32 [Relu] inputs: [260 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_32 for ONNX node: Relu_32 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 190 for ONNX tensor: 190 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_32 [Relu] outputs: [190 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_33 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 190 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 183 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_33 [Add] inputs: [190 -> (1, 64, 24, 32)], [183 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_33 for ONNX node: Add_33 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 191 for ONNX tensor: 191 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_33 [Add] outputs: [191 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_34 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 191 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 264 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 265 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_34 [Conv] inputs: [191 -> (1, 64, 24, 32)], [264 -> (64, 64, 3, 3)], [265 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_34 for ONNX node: Conv_34 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (4, 4), postpadding: (4, 4), dilations: (4, 4), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 263 for ONNX tensor: 263 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_34 [Conv] outputs: [263 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_35 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 263 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_35 [Relu] inputs: [263 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_35 for ONNX node: Relu_35 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 194 for ONNX tensor: 194 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_35 [Relu] outputs: [194 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_36 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 194 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 267 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 268 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_36 [Conv] inputs: [194 -> (1, 64, 24, 32)], [267 -> (64, 64, 3, 3)], [268 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_36 for ONNX node: Conv_36 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 266 for ONNX tensor: 266 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_36 [Conv] outputs: [266 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_37 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 266 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_37 [Relu] inputs: [266 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_37 for ONNX node: Relu_37 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 197 for ONNX tensor: 197 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_37 [Relu] outputs: [197 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_38 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 197 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 194 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_38 [Add] inputs: [197 -> (1, 64, 24, 32)], [194 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_38 for ONNX node: Add_38 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 198 for ONNX tensor: 198 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_38 [Add] outputs: [198 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_39 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 198 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 270 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 271 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_39 [Conv] inputs: [198 -> (1, 64, 24, 32)], [270 -> (64, 64, 3, 3)], [271 -> (64)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_39 for ONNX node: Conv_39 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (2, 2), numOutputs: 64 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 269 for ONNX tensor: 269 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_39 [Conv] outputs: [269 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_40 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 269 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_40 [Relu] inputs: [269 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_40 for ONNX node: Relu_40 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 201 for ONNX tensor: 201 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_40 [Relu] outputs: [201 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_41 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 169 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 172 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_41 [Add] inputs: [169 -> (1, 64, 24, 32)], [172 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_41 for ONNX node: Add_41 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 202 for ONNX tensor: 202 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_41 [Add] outputs: [202 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_42 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 202 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 179 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_42 [Add] inputs: [202 -> (1, 64, 24, 32)], [179 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_42 for ONNX node: Add_42 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 203 for ONNX tensor: 203 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_42 [Add] outputs: [203 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_43 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 203 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 183 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_43 [Add] inputs: [203 -> (1, 64, 24, 32)], [183 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_43 for ONNX node: Add_43 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 204 for ONNX tensor: 204 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_43 [Add] outputs: [204 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_44 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 204 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 190 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_44 [Add] inputs: [204 -> (1, 64, 24, 32)], [190 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_44 for ONNX node: Add_44 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 205 for ONNX tensor: 205 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_44 [Add] outputs: [205 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_45 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 205 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 194 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_45 [Add] inputs: [205 -> (1, 64, 24, 32)], [194 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_45 for ONNX node: Add_45 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 206 for ONNX tensor: 206 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_45 [Add] outputs: [206 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_46 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 206 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 201 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_46 [Add] inputs: [206 -> (1, 64, 24, 32)], [201 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_46 for ONNX node: Add_46 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 207 for ONNX tensor: 207 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_46 [Add] outputs: [207 -> (1, 64, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_47 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 207 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 273 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 274 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_47 [Conv] inputs: [207 -> (1, 64, 24, 32)], [273 -> (48, 64, 3, 3)], [274 -> (48)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_47 for ONNX node: Conv_47 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 48 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 24, 32) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 272 for ONNX tensor: 272 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_47 [Conv] outputs: [272 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_48 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 272 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_48 [Relu] inputs: [272 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_48 for ONNX node: Relu_48 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 210 for ONNX tensor: 210 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_48 [Relu] outputs: [210 -> (1, 48, 24, 32)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: ConvTranspose_49 [ConvTranspose] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 210 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: Panoptic3_up.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: ConvTranspose_49 [ConvTranspose] inputs: [210 -> (1, 48, 24, 32)], [Panoptic3_up.weight -> (48, 1, 4, 4)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:697: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: ConvTranspose_49 for ONNX node: ConvTranspose_49 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 211 for ONNX tensor: 211 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: ConvTranspose_49 [ConvTranspose] outputs: [211 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_50 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 158 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 276 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 277 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_50 [Conv] inputs: [158 -> (1, 24, 48, 64)], [276 -> (48, 24, 3, 3)], [277 -> (48)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_50 for ONNX node: Conv_50 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 48 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 275 for ONNX tensor: 275 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_50 [Conv] outputs: [275 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_51 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 275 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_51 [Relu] inputs: [275 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_51 for ONNX node: Relu_51 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 214 for ONNX tensor: 214 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_51 [Relu] outputs: [214 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_52 [Add] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 214 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 211 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Add_52 [Add] inputs: [214 -> (1, 48, 48, 64)], [211 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Add_52 for ONNX node: Add_52 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 215 for ONNX tensor: 215 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Add_52 [Add] outputs: [215 -> (1, 48, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_53 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 215 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 279 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 280 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_53 [Conv] inputs: [215 -> (1, 48, 48, 64)], [279 -> (24, 24, 3, 3)], [280 -> (24)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_53 for ONNX node: Conv_53 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 278 for ONNX tensor: 278 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_53 [Conv] outputs: [278 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_54 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 278 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_54 [Relu] inputs: [278 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_54 for ONNX node: Relu_54 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 218 for ONNX tensor: 218 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_54 [Relu] outputs: [218 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_55 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 218 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 282 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 283 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_55 [Conv] inputs: [218 -> (1, 24, 48, 64)], [282 -> (24, 24, 3, 3)], [283 -> (24)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_55 for ONNX node: Conv_55 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 48, 64) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 281 for ONNX tensor: 281 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_55 [Conv] outputs: [281 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_56 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 281 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_56 [Relu] inputs: [281 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_56 for ONNX node: Relu_56 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 221 for ONNX tensor: 221 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_56 [Relu] outputs: [221 -> (1, 24, 48, 64)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: ConvTranspose_57 [ConvTranspose] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 221 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: deconv2.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: ConvTranspose_57 [ConvTranspose] inputs: [221 -> (1, 24, 48, 64)], [deconv2.weight -> (24, 1, 4, 4)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:697: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: ConvTranspose_57 for ONNX node: ConvTranspose_57 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 222 for ONNX tensor: 222 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: ConvTranspose_57 [ConvTranspose] outputs: [222 -> (1, 24, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_58 [Conv] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 222 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 285 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 286 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Conv_58 [Conv] inputs: [222 -> (1, 24, 96, 128)], [285 -> (8, 24, 3, 3)], [286 -> (8)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Conv_58 for ONNX node: Conv_58 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 8 [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 8, 96, 128) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 284 for ONNX tensor: 284 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Conv_58 [Conv] outputs: [284 -> (1, 8, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_59 [Relu] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 284 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: Relu_59 [Relu] inputs: [284 -> (1, 8, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: Relu_59 for ONNX node: Relu_59 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: 225 for ONNX tensor: 225 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: Relu_59 [Relu] outputs: [225 -> (1, 8, 96, 128)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:103: Parsing node: ConvTranspose_60 [ConvTranspose] [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: 225 [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:119: Searching for input: deconv1.weight [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:125: ConvTranspose_60 [ConvTranspose] inputs: [225 -> (1, 8, 96, 128)], [deconv1.weight -> (8, 1, 4, 4)], [02/03/2021-16:09:16] [V] [TRT] builtin_op_importers.cpp:697: Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:141: Registering layer: ConvTranspose_60 for ONNX node: ConvTranspose_60 [02/03/2021-16:09:16] [V] [TRT] ImporterContext.hpp:116: Registering tensor: output_1 for ONNX tensor: output [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:179: ConvTranspose_60 [ConvTranspose] outputs: [output -> (1, 8, 192, 256)], [02/03/2021-16:09:16] [V] [TRT] ModelImporter.cpp:507: Marking output_1 as output: output ----- Parsing of ONNX model ../samples/sampleSEGNET/APA_FS_Model.onnx is Done ---- [02/03/2021-16:09:16] [I] FP32 and INT8 precisions have been specified - more performance might be enabled by additionally specifying --fp16 or --best [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for (Unnamed Layer* 0) [Constant]_output to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for (Unnamed Layer* 1) [Shuffle]_output to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for input to [-2,2] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 147 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 227 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 150 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 230 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 153 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 154 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 233 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 157 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 158 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 236 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 161 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 162 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 239 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 165 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 166 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 242 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 169 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 245 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 172 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 248 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 175 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 176 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 251 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 179 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 180 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 254 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 183 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 257 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 186 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 187 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 260 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 190 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 191 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 263 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 194 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 266 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 197 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 198 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 269 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 201 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 202 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 203 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 204 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 205 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 206 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 207 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 272 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 210 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 211 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 275 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 214 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 215 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 278 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 218 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 281 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 221 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 222 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 284 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for 225 to [-4,4] [02/03/2021-16:09:16] [V] [TRT] Setting dynamic range for output to [-4,4] [02/03/2021-16:09:16] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-2,2] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] User overriding scale with dynamic range [-4,4] [02/03/2021-16:09:16] [V] [TRT] Original: 62 layers [02/03/2021-16:09:16] [V] [TRT] After dead-layer removal: 62 layers [02/03/2021-16:09:16] [V] [TRT] Fusing (Unnamed Layer* 0) [Constant] with (Unnamed Layer* 1) [Shuffle] [02/03/2021-16:09:16] [V] [TRT] After Myelin optimization: 61 layers [02/03/2021-16:09:16] [V] [TRT] Fusing (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] with Add_1 [02/03/2021-16:09:16] [V] [TRT] After scale fusion: 60 layers [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_2 with Relu_3 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_4 with Relu_5 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_7 with Relu_8 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_50 with Relu_51 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_10 with Relu_11 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_13 with Relu_14 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_16 with Relu_17 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_18 with Relu_19 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_20 with Relu_21 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_23 with Relu_24 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_26 with Relu_27 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_28 with Relu_29 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_31 with Relu_32 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_34 with Relu_35 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_36 with Relu_37 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_39 with Relu_40 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_47 with Relu_48 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_53 with Relu_54 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_55 with Relu_56 [02/03/2021-16:09:16] [V] [TRT] Fusing Conv_58 with Relu_59 [02/03/2021-16:09:16] [V] [TRT] Fusing Add_41 with Add_42 [02/03/2021-16:09:16] [V] [TRT] Fusing PWN(Add_41, Add_42) with Add_43 [02/03/2021-16:09:16] [V] [TRT] Fusing PWN(PWN(Add_41, Add_42), Add_43) with Add_44 [02/03/2021-16:09:16] [V] [TRT] Fusing PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44) with Add_45 [02/03/2021-16:09:16] [V] [TRT] Fusing PWN(PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44), Add_45) with Add_46 [02/03/2021-16:09:16] [V] [TRT] After vertical fusions: 35 layers [02/03/2021-16:09:16] [V] [TRT] After final dead-layer removal: 35 layers [02/03/2021-16:09:16] [V] [TRT] Merging layers: Conv_50 + Relu_51 || Conv_10 + Relu_11 [02/03/2021-16:09:16] [V] [TRT] After tensor merging: 34 layers [02/03/2021-16:09:16] [V] [TRT] After concat removal: 34 layers [02/03/2021-16:09:16] [V] [TRT] Dynamic range would not be set for tensor Conv_50 + Relu_51 || Conv_10 + Relu_11. TensorRT does not support Int8 precision for tensors of index type or with dims < 4, expect fall back to non-int8 implementation for any layer consuming or producing given tensor. [02/03/2021-16:09:16] [V] [TRT] Configuring builder for Int8 Mode completed in 0.0193285 seconds. [02/03/2021-16:09:16] [V] [TRT] Graph construction and optimization completed in 0.0212084 seconds. [02/03/2021-16:09:16] [I] [TRT] [02/03/2021-16:09:16] [I] [TRT] --------------- Layers running on DLA: [02/03/2021-16:09:16] [I] [TRT] [02/03/2021-16:09:16] [I] [TRT] --------------- Layers running on GPU: [02/03/2021-16:09:16] [I] [TRT] (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1, Conv_2 + Relu_3, Conv_4 + Relu_5, Conv_6, Conv_7 + Relu_8, Add_9, Conv_50 + Relu_51 || Conv_10 + Relu_11, Conv_12, Conv_13 + Relu_14, Add_15, Conv_16 + Relu_17, Conv_18 + Relu_19, Conv_20 + Relu_21, Add_22, Conv_23 + Relu_24, Add_25, Conv_26 + Relu_27, Conv_28 + Relu_29, Add_30, Conv_31 + Relu_32, Add_33, Conv_34 + Relu_35, Conv_36 + Relu_37, Add_38, Conv_39 + Relu_40, PWN(PWN(PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44), Add_45), Add_46), Conv_47 + Relu_48, ConvTranspose_49, Add_52, Conv_53 + Relu_54, Conv_55 + Relu_56, ConvTranspose_57, Conv_58 + Relu_59, ConvTranspose_60, [02/03/2021-16:09:18] [V] [TRT] Constructing optimization profile number 0 [1/1]. [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.988904 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.04494 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.04494 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.997376 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.244488 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.244488 [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Float(1,256,49152,147456) -> Float(1,256,49152,147456) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.07424 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.07424 [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Float(1,256,49152,147456) -> Int8(1,256,49152:4,49152) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Scale has no valid tactics for this config, skipping [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Float(1,256,49152,147456) -> Int8(1,256,49152:32,49152) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Scale has no valid tactics for this config, skipping [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:4,49152) -> Float(1,256,49152,147456) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Scale has no valid tactics for this config, skipping [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:4,49152) -> Int8(1,256,49152:4,49152) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.066568 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.066568 [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:32,49152) -> Float(1,256,49152,147456) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Scale has no valid tactics for this config, skipping [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:32,49152) -> Int8(1,256,49152:32,49152) *************** [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 0) [Constant] + (Unnamed Layer* 1) [Shuffle] + Add_1 (Scale) [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.387188 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.387188 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.795644 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.09012 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.09012 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.786684 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.090896 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.090896 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.994044 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.031108 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.031108 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.986232 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.199296 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.199296 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 1.42952 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.051856 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.051856 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 1.36908 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.102 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.102 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.74124 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.079356 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.079356 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 1.4367 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.197504 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.197504 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 1.41401 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.185228 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.185228 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:18] [V] [TRT] Tactic: 1002 time 0.76734 [02/03/2021-16:09:18] [V] [TRT] Tactic: 0 time 0.124416 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 0 Time: 0.124416 [02/03/2021-16:09:18] [V] [TRT] *************** Autotuning format combination: Float(1,256,49152,147456) -> Float(1,128,12288,147456) *************** [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:18] [V] [TRT] Tactic: 458751 time 0.336772 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: 458751 Time: 0.336772 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: 1825138533642645384 time 0.47168 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: 2842488832350522458 time 0.27496 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: 3915320020053085238 time 0.47066 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: 6448355332020552203 time 0.670196 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: 6808617066150061604 time 0.248836 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: -8060443123034038864 time 0.252672 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: -4420849921117327522 time 0.16 [02/03/2021-16:09:18] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:18] [V] [TRT] Tactic: -3946921629105938337 time 0.147852 [02/03/2021-16:09:18] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.147852 [02/03/2021-16:09:18] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:19] [V] [TRT] Tactic: 0 time 0.283672 [02/03/2021-16:09:19] [V] [TRT] Tactic: 2 time 0.539012 [02/03/2021-16:09:19] [V] [TRT] Tactic: 5 time 6.94888 [02/03/2021-16:09:19] [V] [TRT] Tactic: 57 time 0.300924 [02/03/2021-16:09:19] [V] [TRT] Fastest Tactic: 0 Time: 0.283672 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152,147456) -> Int8(1,128,12288:32,12288) *************** [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:4,49152) -> Float(1,128,12288,147456) *************** [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 892787096507693407 time 0.356356 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 1204440019753223942 time 0.159988 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 1659301557717208403 time 0.110076 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 2057291331119027912 time 0.191864 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 3275977259705528576 time 0.156436 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 5623454780463195174 time 0.113536 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 8930254200803946944 time 0.218244 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -9204333525109552344 time 0.189696 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -4973811344878172338 time 0.359564 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -1228371230285617088 time 0.549756 [02/03/2021-16:09:19] [V] [TRT] Fastest Tactic: 1659301557717208403 Time: 0.110076 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:4,49152) -> Int8(1,128,12288:4,36864) *************** [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 4438325421691896755 time 0.143376 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 4581732244273465060 time 0.143368 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 4934335053031119367 time 0.117764 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 6797040896965118050 time 0.2684 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 8006952294591770973 time 0.085756 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -7210942453088153035 time 0.267264 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -6282183216199417697 time 0.08166 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -5026383765466876607 time 0.405252 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -5016725782072253841 time 0.11264 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: -1370999262391786833 time 0.164632 [02/03/2021-16:09:19] [V] [TRT] Fastest Tactic: -6282183216199417697 Time: 0.08166 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:19] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:4,49152) -> Int8(1,128,12288:32,12288) *************** [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:19] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 1213457772632185722 time 0.125692 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 1713441381477652893 time 0.093216 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 7125598890155666458 time 0.168456 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:19] [V] [TRT] Tactic: 8047041638267142825 time 0.089616 [02/03/2021-16:09:19] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -7846982807478255793 time 0.145148 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -6459719113600909000 time 0.125076 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -4573925292554651334 time 0.267528 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -3566249366964946311 time 0.148496 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -2002418013575043687 time 0.271996 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -1659631603542281459 time 0.41534 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 8047041638267142825 Time: 0.089616 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:20] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:32,49152) -> Float(1,128,12288:32,12288) *************** [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] *************** Autotuning format combination: Int8(1,256,49152:32,49152) -> Int8(1,128,12288:32,12288) *************** [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (FusedConvActConvolution) [02/03/2021-16:09:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CaskConvolution) [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: 66319348402778770 time 0.34022 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: 1931698692231796048 time 0.238708 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2271687430539765460 time 0.384416 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: 7039764449991095921 time 0.234368 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -9114895246540757312 time 0.220044 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -8787970778927801941 time 0.35958 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -8225786209923559953 time 0.390524 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -7373087278866484214 time 0.221432 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -7274936339335021260 time 0.236804 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -2102888629196925141 time 0.214912 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -674235064782459186 time 0.381712 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Tactic: -182858804213663094 time 0.338156 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.214912 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaDepthwiseConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_2 + Relu_3 (CudaGroupConvolution) [02/03/2021-16:09:20] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_2 + Relu_3 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.304392 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.043268 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.043268 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.305024 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.211984 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.211984 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.22438 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.269688 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.22438 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.305804 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.27136 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.27136 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.248956 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.425872 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.248956 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.404612 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.051336 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.051336 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.310652 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.033288 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.033288 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.401656 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.132492 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.132492 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:20] [V] [TRT] Tactic: 1002 time 0.305792 [02/03/2021-16:09:20] [V] [TRT] Tactic: 0 time 0.0416 [02/03/2021-16:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0416 [02/03/2021-16:09:20] [V] [TRT] *************** Autotuning format combination: Float(1,128,12288,147456) -> Float(1,128,12288,294912) *************** [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:20] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:20] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:20] [V] [TRT] Tactic: 524287 time 0.82662 [02/03/2021-16:09:20] [V] [TRT] Tactic: 720895 time 0.755192 [02/03/2021-16:09:20] [V] [TRT] Tactic: 983039 time 0.728836 [02/03/2021-16:09:20] [V] [TRT] Tactic: 1048575 time 0.754172 [02/03/2021-16:09:20] [V] [TRT] Tactic: 1703935 time 0.755068 [02/03/2021-16:09:20] [V] [TRT] Tactic: 1966079 time 0.989696 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2031615 time 1.00493 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2228223 time 0.752276 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2752511 time 0.781844 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2818047 time 1.49491 [02/03/2021-16:09:20] [V] [TRT] Tactic: 2883583 time 1.10196 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3014655 time 0.558156 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3145727 time 0.551976 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3473407 time 1.01577 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3604479 time 0.55538 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3735551 time 0.945388 [02/03/2021-16:09:21] [V] [TRT] Tactic: 4390911 time 0.78628 [02/03/2021-16:09:21] [V] [TRT] Tactic: 5046271 time 0.46382 [02/03/2021-16:09:21] [V] [TRT] Tactic: 5963775 time 0.605764 [02/03/2021-16:09:21] [V] [TRT] Tactic: 6160383 time 0.496116 [02/03/2021-16:09:21] [V] [TRT] Tactic: 6488063 time 0.458828 [02/03/2021-16:09:21] [V] [TRT] Tactic: 6881279 time 0.604112 [02/03/2021-16:09:21] [V] [TRT] Tactic: 7995391 time 0.441744 [02/03/2021-16:09:21] [V] [TRT] Tactic: 8585215 time 0.51024 [02/03/2021-16:09:21] [V] [TRT] Tactic: 8978431 time 0.610004 [02/03/2021-16:09:21] [V] [TRT] Tactic: 9043967 time 0.453936 [02/03/2021-16:09:21] [V] [TRT] Tactic: 9175039 time 0.45 [02/03/2021-16:09:21] [V] [TRT] Tactic: 9502719 time 0.610004 [02/03/2021-16:09:21] [V] [TRT] Tactic: 9830399 time 0.78364 [02/03/2021-16:09:21] [V] [TRT] Tactic: 10027007 time 0.462664 [02/03/2021-16:09:21] [V] [TRT] Tactic: 10092543 time 0.633472 [02/03/2021-16:09:21] [V] [TRT] Tactic: 10289151 time 0.60624 [02/03/2021-16:09:21] [V] [TRT] Tactic: 10485759 time 0.423148 [02/03/2021-16:09:21] [V] [TRT] Tactic: 10813439 time 0.350732 [02/03/2021-16:09:21] [V] [TRT] Fastest Tactic: 10813439 Time: 0.350732 [02/03/2021-16:09:21] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 1825138533642645384 time 0.63182 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 2775507031594384867 time 0.159548 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 2842488832350522458 time 0.33268 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 3915320020053085238 time 0.626576 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 6448355332020552203 time 0.742316 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: 6808617066150061604 time 0.326764 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: -8060443123034038864 time 0.33118 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: -4420849921117327522 time 0.192052 [02/03/2021-16:09:21] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:21] [V] [TRT] Tactic: -3946921629105938337 time 0.190844 [02/03/2021-16:09:21] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.159548 [02/03/2021-16:09:21] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:21] [V] [TRT] Tactic: 0 time 0.351564 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2 time 1.69146 [02/03/2021-16:09:22] [V] [TRT] Tactic: 5 time 3.2163 [02/03/2021-16:09:22] [V] [TRT] Tactic: 6 time 0.274588 [02/03/2021-16:09:22] [V] [TRT] Tactic: 57 time 0.349176 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 6 Time: 0.274588 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:22] [V] [TRT] [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:22] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,36864) -> Float(1,128,12288,294912) *************** [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 892787096507693407 time 0.238612 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1204440019753223942 time 0.104844 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1659301557717208403 time 0.07704 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2057291331119027912 time 0.130848 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 3275977259705528576 time 0.100544 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 5623454780463195174 time 0.079744 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8930254200803946944 time 0.145788 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -9204333525109552344 time 0.127076 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -4973811344878172338 time 0.235288 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -1228371230285617088 time 0.35824 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 1659301557717208403 Time: 0.07704 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaGroupConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,36864) -> Int8(1,128,12288:4,73728) *************** [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:22] [V] [TRT] Tactic: 524287 time 0.102696 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1966079 time 0.121456 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2031615 time 0.131444 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2883583 time 0.212388 [02/03/2021-16:09:22] [V] [TRT] Tactic: 4390911 time 0.139976 [02/03/2021-16:09:22] [V] [TRT] Tactic: 5963775 time 0.137588 [02/03/2021-16:09:22] [V] [TRT] Tactic: 6881279 time 0.134084 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8585215 time 0.10824 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8978431 time 0.1268 [02/03/2021-16:09:22] [V] [TRT] Tactic: 9502719 time 0.142888 [02/03/2021-16:09:22] [V] [TRT] Tactic: 10092543 time 0.140128 [02/03/2021-16:09:22] [V] [TRT] Tactic: 10289151 time 0.120036 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 524287 Time: 0.102696 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 4438325421691896755 time 0.114432 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 4581732244273465060 time 0.112084 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 4934335053031119367 time 0.087496 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 6797040896965118050 time 0.205824 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8006952294591770973 time 0.066444 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -7210942453088153035 time 0.203088 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -6282183216199417697 time 0.063468 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -5026383765466876607 time 0.290272 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -5016725782072253841 time 0.081956 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -1370999262391786833 time 0.121432 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: -6282183216199417697 Time: 0.063468 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaGroupConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:22] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,36864) -> Int8(1,128,12288:32,12288) *************** [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1213457772632185722 time 0.086724 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1713441381477652893 time 0.065804 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 7125598890155666458 time 0.120096 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8047041638267142825 time 0.063848 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -7846982807478255793 time 0.111832 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -6459719113600909000 time 0.081948 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -4573925292554651334 time 0.200332 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -3566249366964946311 time 0.113588 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -2002418013575043687 time 0.206932 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -1659631603542281459 time 0.29028 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 8047041638267142825 Time: 0.063848 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaGroupConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:22] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:32,12288) -> Float(1,128,12288:32,12288) *************** [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaGroupConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:32,12288) -> Int8(1,128,12288:32,12288) *************** [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (FusedConvActConvolution) [02/03/2021-16:09:22] [V] [TRT] Tactic: 524287 time 0.085788 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1966079 time 0.127564 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2031615 time 0.136 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2883583 time 0.222644 [02/03/2021-16:09:22] [V] [TRT] Tactic: 4390911 time 0.13918 [02/03/2021-16:09:22] [V] [TRT] Tactic: 5963775 time 0.144632 [02/03/2021-16:09:22] [V] [TRT] Tactic: 6881279 time 0.139536 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8585215 time 0.09754 [02/03/2021-16:09:22] [V] [TRT] Tactic: 8978431 time 0.126528 [02/03/2021-16:09:22] [V] [TRT] Tactic: 9502719 time 0.144556 [02/03/2021-16:09:22] [V] [TRT] Tactic: 10092543 time 0.1398 [02/03/2021-16:09:22] [V] [TRT] Tactic: 10289151 time 0.12748 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 524287 Time: 0.085788 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CaskConvolution) [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 66319348402778770 time 0.16844 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 1931698692231796048 time 0.103384 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 2271687430539765460 time 0.1892 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: 7039764449991095921 time 0.099348 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -9114895246540757312 time 0.098156 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -8787970778927801941 time 0.175728 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -8225786209923559953 time 0.18914 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -7373087278866484214 time 0.100828 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -7274936339335021260 time 0.100756 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -2102888629196925141 time 0.097344 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -674235064782459186 time 0.188468 [02/03/2021-16:09:22] [V] [TRT] Conv_4 + Relu_5 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:22] [V] [TRT] Tactic: -182858804213663094 time 0.166252 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.097344 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaDepthwiseConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: Conv_4 + Relu_5 (CudaGroupConvolution) [02/03/2021-16:09:22] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 524287 [02/03/2021-16:09:22] [V] [TRT] [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:22] [V] [TRT] Tactic: 1002 time 0.178992 [02/03/2021-16:09:22] [V] [TRT] Tactic: 0 time 0.034152 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 0 Time: 0.034152 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:22] [V] [TRT] Tactic: 1002 time 0.178524 [02/03/2021-16:09:22] [V] [TRT] Tactic: 0 time 0.197176 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.178524 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:22] [V] [TRT] Tactic: 1002 time 0.203988 [02/03/2021-16:09:22] [V] [TRT] Tactic: 0 time 0.265912 [02/03/2021-16:09:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.203988 [02/03/2021-16:09:22] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.18214 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.26672 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.18214 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.150504 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.418608 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.150504 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.216484 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.043204 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 0 Time: 0.043204 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.181096 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.023636 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 0 Time: 0.023636 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.217252 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.123908 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 0 Time: 0.123908 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.17932 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.025572 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 0 Time: 0.025572 [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Float(1,128,12288,294912) -> Float(1,64,3072,73728) *************** [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: 1825138533642645384 time 1.30476 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: 2842488832350522458 time 0.807 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: 3915320020053085238 time 1.2973 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: 6448355332020552203 time 1.6678 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: 6808617066150061604 time 0.824008 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: -8060443123034038864 time 0.830472 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: -4420849921117327522 time 0.517512 [02/03/2021-16:09:23] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:23] [V] [TRT] Tactic: -3946921629105938337 time 0.631564 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.517512 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.03946 [02/03/2021-16:09:23] [V] [TRT] Tactic: 2 time 0.039832 [02/03/2021-16:09:23] [V] [TRT] Tactic: 5 time 13.7824 [02/03/2021-16:09:23] [V] [TRT] Tactic: 57 time 0.022096 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 57 Time: 0.022096 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] Tactic: -1 time 0.03978 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: -1 Time: 0.03978 [02/03/2021-16:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [02/03/2021-16:09:23] [V] [TRT] [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,73728) -> Float(1,64,3072,73728) *************** [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaGroupConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,73728) -> Int8(1,64,3072:4,18432) *************** [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] Tactic: -3 time 0.011344 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: -3 Time: 0.011344 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaGroupConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3 [02/03/2021-16:09:23] [V] [TRT] [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:4,73728) -> Int8(1,64,3072:32,3072) *************** [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaGroupConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:32,12288) -> Float(1,64,3072:32,3072) *************** [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaGroupConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] *************** Autotuning format combination: Int8(1,128,12288:32,12288) -> Int8(1,64,3072:32,3072) *************** [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [02/03/2021-16:09:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [02/03/2021-16:09:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [02/03/2021-16:09:23] [V] [TRT] Tactic: -4 time 0.00988 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.01146 [02/03/2021-16:09:23] [V] [TRT] Tactic: 1 time 0.009916 [02/03/2021-16:09:23] [V] [TRT] Tactic: 2 time 0.013164 [02/03/2021-16:09:23] [V] [TRT] Tactic: 3 time 0.011368 [02/03/2021-16:09:23] [V] [TRT] Tactic: 4 time 0.018892 [02/03/2021-16:09:23] [V] [TRT] Tactic: 5 time 0.014604 [02/03/2021-16:09:23] [V] [TRT] Tactic: 6 time 0.030488 [02/03/2021-16:09:23] [V] [TRT] Tactic: 7 time 0.022216 [02/03/2021-16:09:23] [V] [TRT] Tactic: 8 time 0.051856 [02/03/2021-16:09:23] [V] [TRT] Tactic: 9 time 0.032176 [02/03/2021-16:09:23] [V] [TRT] Tactic: 10 time 0.011408 [02/03/2021-16:09:23] [V] [TRT] Tactic: 11 time 0.00976 [02/03/2021-16:09:23] [V] [TRT] Tactic: 12 time 0.013056 [02/03/2021-16:09:23] [V] [TRT] Tactic: 13 time 0.01104 [02/03/2021-16:09:23] [V] [TRT] Tactic: 14 time 0.018668 [02/03/2021-16:09:23] [V] [TRT] Tactic: 15 time 0.014176 [02/03/2021-16:09:23] [V] [TRT] Tactic: 16 time 0.030956 [02/03/2021-16:09:23] [V] [TRT] Tactic: 17 time 0.020636 [02/03/2021-16:09:23] [V] [TRT] Tactic: 18 time 0.051932 [02/03/2021-16:09:23] [V] [TRT] Tactic: 19 time 0.032212 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 11 Time: 0.00976 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaGroupConvolution) [02/03/2021-16:09:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 11 [02/03/2021-16:09:23] [V] [TRT] [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.02312 [02/03/2021-16:09:23] [V] [TRT] Tactic: 0 time 0.039208 [02/03/2021-16:09:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.02312 [02/03/2021-16:09:23] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:23] [V] [TRT] Tactic: 1002 time 0.023744 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006096 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006096 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.023764 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.02506 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.023764 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.02642 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.01886 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.01886 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.023952 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.016812 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.016812 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.021444 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.030284 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.021444 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.028376 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.007464 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.007464 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.024372 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.036712 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.024372 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.023956 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006132 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006132 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.028372 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.013204 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.013204 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.02058 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.039292 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.02058 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.024232 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006148 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006148 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.02376 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006152 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006152 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.023844 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.025052 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.023844 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.026268 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.018624 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.018624 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.024116 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.016756 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.016756 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.021292 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.030292 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.021292 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.028488 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.007608 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.007608 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.024596 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006064 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006064 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.028452 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.013344 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.013344 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.024208 [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.006076 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 0 Time: 0.006076 [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Float(1,64,3072,73728) -> Float(1,64,3072,73728) *************** [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1825138533642645384 time 0.14134 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 2842488832350522458 time 0.078864 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 3915320020053085238 time 0.142552 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 6448355332020552203 time 0.1545 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 6808617066150061604 time 0.078044 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -8060443123034038864 time 0.077516 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -4420849921117327522 time 0.04946 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -3946921629105938337 time 0.062556 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.04946 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] Tactic: 0 time 0.076352 [02/03/2021-16:09:24] [V] [TRT] Tactic: 2 time 0.127536 [02/03/2021-16:09:24] [V] [TRT] Tactic: 57 time 0.075416 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 57 Time: 0.075416 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Float(1,64,3072,73728) *************** [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 892787096507693407 time 0.045524 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1204440019753223942 time 0.023096 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1659301557717208403 time 0.02302 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 2057291331119027912 time 0.028716 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 3275977259705528576 time 0.022048 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 5623454780463195174 time 0.02368 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 8930254200803946944 time 0.028948 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -9204333525109552344 time 0.028836 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -4973811344878172338 time 0.045504 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -1228371230285617088 time 0.057456 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: 3275977259705528576 Time: 0.022048 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaGroupConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3275977259705528576 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Int8(1,64,3072:4,18432) *************** [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 4438325421691896755 time 0.026628 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 4581732244273465060 time 0.02618 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 4934335053031119367 time 0.020224 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 6797040896965118050 time 0.04288 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 8006952294591770973 time 0.021748 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -7210942453088153035 time 0.041844 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -6282183216199417697 time 0.020208 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -5026383765466876607 time 0.050112 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -5016725782072253841 time 0.020204 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -1370999262391786833 time 0.026728 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: -5016725782072253841 Time: 0.020204 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaGroupConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5016725782072253841 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Int8(1,64,3072:32,3072) *************** [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1213457772632185722 time 0.02032 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1713441381477652893 time 0.021288 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 7125598890155666458 time 0.026132 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 8047041638267142825 time 0.020276 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -7846982807478255793 time 0.02586 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -6459719113600909000 time 0.019988 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -4573925292554651334 time 0.041936 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -3566249366964946311 time 0.026528 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -2002418013575043687 time 0.042252 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -1659631603542281459 time 0.050016 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: -6459719113600909000 Time: 0.019988 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaGroupConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6459719113600909000 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,3072) -> Float(1,64,3072:32,3072) *************** [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaGroupConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,3072) -> Int8(1,64,3072:32,3072) *************** [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (FusedConvActConvolution) [02/03/2021-16:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CaskConvolution) [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 66319348402778770 time 0.025384 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 1931698692231796048 time 0.018784 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 2271687430539765460 time 0.031188 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: 7039764449991095921 time 0.018652 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -9114895246540757312 time 0.018648 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -8787970778927801941 time 0.02652 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -8225786209923559953 time 0.031336 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -7373087278866484214 time 0.01884 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -7274936339335021260 time 0.018756 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -2102888629196925141 time 0.017952 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -674235064782459186 time 0.031028 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Tactic: -182858804213663094 time 0.0247 [02/03/2021-16:09:24] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.017952 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaDepthwiseConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: Conv_7 + Relu_8 (CudaGroupConvolution) [02/03/2021-16:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] Conv_7 + Relu_8 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:24] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:24] [V] [TRT] Tactic: 1002 time 0.022328 [02/03/2021-16:09:25] [V] [TRT] Tactic: 0 time 0.0385 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.022328 [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1002 time 0.023512 [02/03/2021-16:09:25] [V] [TRT] Tactic: 0 time 0.035796 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.023512 [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1002 time 0.020252 [02/03/2021-16:09:25] [V] [TRT] Tactic: 0 time 0.038248 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.020252 [02/03/2021-16:09:25] [V] [TRT] *************** Autotuning format combination: Float(1,64,3072,73728), Float(1,64,3072,73728) -> Float(1,64,3072,73728) *************** [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: Add_9 (ElementWise) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1 time 0.012684 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2 time 0.024516 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1 Time: 0.012684 [02/03/2021-16:09:25] [V] [TRT] *************** Autotuning format combination: Float(1,64,3072:32,3072), Float(1,64,3072:32,3072) -> Float(1,64,3072:32,3072) *************** [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: Add_9 (ElementWise) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1 time 0.014728 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2 time 0.025308 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1 Time: 0.014728 [02/03/2021-16:09:25] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432), Int8(1,64,3072:4,18432) -> Int8(1,64,3072:4,18432) *************** [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: Add_9 (ElementWise) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1 time 0.007704 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2 time 0.007608 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 2 Time: 0.007608 [02/03/2021-16:09:25] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,3072), Int8(1,64,3072:32,3072) -> Int8(1,64,3072:32,3072) *************** [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: Add_9 (ElementWise) [02/03/2021-16:09:25] [V] [TRT] Tactic: 1 time 0.007636 [02/03/2021-16:09:25] [V] [TRT] Fastest Tactic: 1 Time: 0.007636 [02/03/2021-16:09:25] [V] [TRT] *************** Autotuning format combination: Float(1,64,3072,73728) -> Float(1,64,3072,294912) *************** [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:25] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:25] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:25] [V] [TRT] Tactic: 524287 time 0.211204 [02/03/2021-16:09:25] [V] [TRT] Tactic: 720895 time 0.190156 [02/03/2021-16:09:25] [V] [TRT] Tactic: 983039 time 0.19036 [02/03/2021-16:09:25] [V] [TRT] Tactic: 1048575 time 0.17024 [02/03/2021-16:09:25] [V] [TRT] Tactic: 1703935 time 0.165348 [02/03/2021-16:09:25] [V] [TRT] Tactic: 1769471 time 0.286032 [02/03/2021-16:09:25] [V] [TRT] Tactic: 1966079 time 0.260472 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2031615 time 0.248152 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2228223 time 0.170012 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2621439 time 0.194064 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2752511 time 0.201896 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2818047 time 0.247876 [02/03/2021-16:09:25] [V] [TRT] Tactic: 2883583 time 0.282412 [02/03/2021-16:09:25] [V] [TRT] Tactic: 3014655 time 0.165772 [02/03/2021-16:09:25] [V] [TRT] Tactic: 3145727 time 0.187756 [02/03/2021-16:09:25] [V] [TRT] Tactic: 3473407 time 0.22146 [02/03/2021-16:09:25] [V] [TRT] Tactic: 3604479 time 0.161116 [02/03/2021-16:09:25] [V] [TRT] Tactic: 3735551 time 0.230684 [02/03/2021-16:09:25] [V] [TRT] Tactic: 4390911 time 0.262988 [02/03/2021-16:09:25] [V] [TRT] Tactic: 5046271 time 0.173688 [02/03/2021-16:09:25] [V] [TRT] Tactic: 5963775 time 0.25142 [02/03/2021-16:09:25] [V] [TRT] Tactic: 6160383 time 0.208028 [02/03/2021-16:09:25] [V] [TRT] Tactic: 6488063 time 0.175856 [02/03/2021-16:09:25] [V] [TRT] Tactic: 6881279 time 0.24082 [02/03/2021-16:09:25] [V] [TRT] Tactic: 7274495 time 0.229864 [02/03/2021-16:09:25] [V] [TRT] Tactic: 7864319 time 0.175888 [02/03/2021-16:09:25] [V] [TRT] Tactic: 7995391 time 0.186052 [02/03/2021-16:09:25] [V] [TRT] Tactic: 8585215 time 0.215764 [02/03/2021-16:09:25] [V] [TRT] Tactic: 8847359 time 0.25788 [02/03/2021-16:09:25] [V] [TRT] Tactic: 8978431 time 0.249256 [02/03/2021-16:09:25] [V] [TRT] Tactic: 9043967 time 0.1679 [02/03/2021-16:09:25] [V] [TRT] Tactic: 9175039 time 0.16064 [02/03/2021-16:09:25] [V] [TRT] Tactic: 9502719 time 0.262992 [02/03/2021-16:09:25] [V] [TRT] Tactic: 9830399 time 0.22264 [02/03/2021-16:09:25] [V] [TRT] Tactic: 10027007 time 0.171376 [02/03/2021-16:09:25] [V] [TRT] Tactic: 10092543 time 0.261928 [02/03/2021-16:09:25] [V] [TRT] Tactic: 10289151 time 0.262648 [02/03/2021-16:09:25] [V] [TRT] Tactic: 10485759 time 0.167908 [02/03/2021-16:09:25] [V] [TRT] Tactic: 10682367 time 0.17514 [02/03/2021-16:09:26] [V] [TRT] Tactic: 10813439 time 0.175536 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 9175039 Time: 0.16064 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1825138533642645384 time 0.137716 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2775507031594384867 time 0.0744 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2842488832350522458 time 0.14312 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 3915320020053085238 time 0.138784 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6448355332020552203 time 0.15064 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6808617066150061604 time 0.142864 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -8060443123034038864 time 0.146208 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -4420849921117327522 time 0.142132 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -3946921629105938337 time 0.1355 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.0744 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:26] [V] [TRT] Tactic: 0 time 0.216716 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2 time 1.46942 [02/03/2021-16:09:26] [V] [TRT] Tactic: 5 time 1.5668 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6 time 0.138452 [02/03/2021-16:09:26] [V] [TRT] Tactic: 57 time 0.215272 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 6 Time: 0.138452 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:26] [V] [TRT] [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:26] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Float(1,64,3072,294912) *************** [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 892787096507693407 time 0.047992 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1204440019753223942 time 0.047548 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1659301557717208403 time 0.047436 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2057291331119027912 time 0.049768 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 3275977259705528576 time 0.0453 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 5623454780463195174 time 0.050892 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 8930254200803946944 time 0.052608 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -9204333525109552344 time 0.04896 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -4973811344878172338 time 0.047796 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -1228371230285617088 time 0.060484 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 3275977259705528576 Time: 0.0453 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaGroupConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3275977259705528576 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Int8(1,64,3072:4,73728) *************** [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:26] [V] [TRT] Tactic: 524287 time 0.055236 [02/03/2021-16:09:26] [V] [TRT] Tactic: 720895 time 0.058076 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1048575 time 0.050724 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1966079 time 0.063112 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2031615 time 0.060708 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2752511 time 0.071276 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2883583 time 0.065608 [02/03/2021-16:09:26] [V] [TRT] Tactic: 3473407 time 0.052588 [02/03/2021-16:09:26] [V] [TRT] Tactic: 3735551 time 0.049972 [02/03/2021-16:09:26] [V] [TRT] Tactic: 4390911 time 0.065652 [02/03/2021-16:09:26] [V] [TRT] Tactic: 5046271 time 0.05156 [02/03/2021-16:09:26] [V] [TRT] Tactic: 5963775 time 0.062504 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6160383 time 0.091368 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6488063 time 0.059156 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6881279 time 0.0606 [02/03/2021-16:09:26] [V] [TRT] Tactic: 7995391 time 0.056036 [02/03/2021-16:09:26] [V] [TRT] Tactic: 8585215 time 0.05764 [02/03/2021-16:09:26] [V] [TRT] Tactic: 8978431 time 0.059736 [02/03/2021-16:09:26] [V] [TRT] Tactic: 9502719 time 0.067828 [02/03/2021-16:09:26] [V] [TRT] Tactic: 9830399 time 0.056448 [02/03/2021-16:09:26] [V] [TRT] Tactic: 10027007 time 0.055048 [02/03/2021-16:09:26] [V] [TRT] Tactic: 10092543 time 0.065976 [02/03/2021-16:09:26] [V] [TRT] Tactic: 10289151 time 0.063936 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 3735551 Time: 0.049972 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 4438325421691896755 time 0.044836 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 4581732244273465060 time 0.043828 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 4934335053031119367 time 0.04068 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 6797040896965118050 time 0.042496 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 8006952294591770973 time 0.040576 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -7210942453088153035 time 0.04186 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -6282183216199417697 time 0.03874 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -5026383765466876607 time 0.049948 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -5016725782072253841 time 0.040276 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -1370999262391786833 time 0.0452 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: -6282183216199417697 Time: 0.03874 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaGroupConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:26] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,18432) -> Int8(1,64,3072:32,9216) *************** [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1213457772632185722 time 0.040528 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1713441381477652893 time 0.040472 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 7125598890155666458 time 0.044608 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: 8047041638267142825 time 0.038848 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -7846982807478255793 time 0.043752 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -6459719113600909000 time 0.03992 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -4573925292554651334 time 0.042912 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -3566249366964946311 time 0.044468 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -2002418013575043687 time 0.042872 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Tactic: -1659631603542281459 time 0.050592 [02/03/2021-16:09:26] [V] [TRT] Fastest Tactic: 8047041638267142825 Time: 0.038848 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaGroupConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8047041638267142825 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:26] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,3072) -> Float(1,64,3072:32,9216) *************** [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaGroupConvolution) [02/03/2021-16:09:26] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:26] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,3072) -> Int8(1,64,3072:32,9216) *************** [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:26] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:26] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (FusedConvActConvolution) [02/03/2021-16:09:26] [V] [TRT] Tactic: 524287 time 0.045552 [02/03/2021-16:09:26] [V] [TRT] Tactic: 720895 time 0.053452 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1048575 time 0.0505 [02/03/2021-16:09:26] [V] [TRT] Tactic: 1966079 time 0.048756 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2031615 time 0.055908 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2752511 time 0.067308 [02/03/2021-16:09:26] [V] [TRT] Tactic: 2883583 time 0.048188 [02/03/2021-16:09:27] [V] [TRT] Tactic: 3473407 time 0.05154 [02/03/2021-16:09:27] [V] [TRT] Tactic: 3735551 time 0.04646 [02/03/2021-16:09:27] [V] [TRT] Tactic: 4390911 time 0.054552 [02/03/2021-16:09:27] [V] [TRT] Tactic: 5046271 time 0.05074 [02/03/2021-16:09:27] [V] [TRT] Tactic: 5963775 time 0.058984 [02/03/2021-16:09:27] [V] [TRT] Tactic: 6160383 time 0.09062 [02/03/2021-16:09:27] [V] [TRT] Tactic: 6488063 time 0.056684 [02/03/2021-16:09:27] [V] [TRT] Tactic: 6881279 time 0.056872 [02/03/2021-16:09:27] [V] [TRT] Tactic: 7995391 time 0.048196 [02/03/2021-16:09:27] [V] [TRT] Tactic: 8585215 time 0.051292 [02/03/2021-16:09:27] [V] [TRT] Tactic: 8978431 time 0.04888 [02/03/2021-16:09:27] [V] [TRT] Tactic: 9502719 time 0.062708 [02/03/2021-16:09:27] [V] [TRT] Tactic: 9830399 time 0.051692 [02/03/2021-16:09:27] [V] [TRT] Tactic: 10027007 time 0.05462 [02/03/2021-16:09:27] [V] [TRT] Tactic: 10092543 time 0.054356 [02/03/2021-16:09:27] [V] [TRT] Tactic: 10289151 time 0.04914 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 524287 Time: 0.045552 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CaskConvolution) [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 66319348402778770 time 0.025956 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 1931698692231796048 time 0.02832 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 2271687430539765460 time 0.031252 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 7039764449991095921 time 0.027116 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -9114895246540757312 time 0.026732 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -8787970778927801941 time 0.02624 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -8225786209923559953 time 0.031592 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -7373087278866484214 time 0.02738 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -7274936339335021260 time 0.028104 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -2102888629196925141 time 0.026288 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -674235064782459186 time 0.03092 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -182858804213663094 time 0.025152 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: -182858804213663094 Time: 0.025152 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaConvolution) [02/03/2021-16:09:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaDepthwiseConvolution) [02/03/2021-16:09:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_50 + Relu_51 || Conv_10 + Relu_11 (CudaGroupConvolution) [02/03/2021-16:09:27] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_50 + Relu_51 || Conv_10 + Relu_11 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.055576 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.132432 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.055576 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.070712 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.016748 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.016748 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.067204 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.086376 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.067204 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.084664 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.067336 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.067336 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.072784 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.059748 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.059748 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.06824 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.113428 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.06824 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.070208 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.024308 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.024308 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.068516 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.129812 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.068516 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.068548 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.013664 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.013664 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.069216 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.042 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.042 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.064908 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.14056 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.064908 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.067072 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.029688 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.029688 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.047304 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.022676 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.022676 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.045648 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.046468 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.045648 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.046256 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.035496 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.035496 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.04808 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.032436 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.032436 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.04644 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.059324 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.04644 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.050124 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.01456 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.01456 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.04332 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.007628 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.007628 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.048404 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.023184 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.023184 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.044248 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.011044 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.011044 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:27] [V] [TRT] Tactic: 1002 time 0.04338 [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.042308 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: 0 Time: 0.042308 [02/03/2021-16:09:27] [V] [TRT] *************** Autotuning format combination: Float(1,64,3072,294912) -> Float(1,32,768,36864) *************** [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 1825138533642645384 time 0.637276 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 2842488832350522458 time 0.568932 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 3915320020053085238 time 0.632352 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 6448355332020552203 time 0.63102 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: 6808617066150061604 time 0.557972 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -8060443123034038864 time 0.569076 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -4420849921117327522 time 0.424728 [02/03/2021-16:09:27] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:27] [V] [TRT] Tactic: -3946921629105938337 time 0.51678 [02/03/2021-16:09:27] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.424728 [02/03/2021-16:09:27] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:27] [V] [TRT] Tactic: 0 time 0.013532 [02/03/2021-16:09:28] [V] [TRT] Tactic: 2 time 0.013428 [02/03/2021-16:09:28] [V] [TRT] Tactic: 5 time 7.61694 [02/03/2021-16:09:28] [V] [TRT] Tactic: 57 time 0.013036 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 57 Time: 0.013036 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] Tactic: -1 time 0.0172 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: -1 Time: 0.0172 [02/03/2021-16:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [02/03/2021-16:09:28] [V] [TRT] [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,73728) -> Float(1,32,768,36864) *************** [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaGroupConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,73728) -> Int8(1,32,768:4,9216) *************** [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] Tactic: -3 time 0.007732 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: -3 Time: 0.007732 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaGroupConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3 [02/03/2021-16:09:28] [V] [TRT] [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:4,73728) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaGroupConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,9216) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaGroupConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Int8(1,64,3072:32,9216) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [02/03/2021-16:09:28] [V] [TRT] Tactic: -4 time 0.007136 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.007668 [02/03/2021-16:09:28] [V] [TRT] Tactic: 1 time 0.007756 [02/03/2021-16:09:28] [V] [TRT] Tactic: 2 time 0.010728 [02/03/2021-16:09:28] [V] [TRT] Tactic: 3 time 0.009016 [02/03/2021-16:09:28] [V] [TRT] Tactic: 4 time 0.015408 [02/03/2021-16:09:28] [V] [TRT] Tactic: 5 time 0.012292 [02/03/2021-16:09:28] [V] [TRT] Tactic: 6 time 0.025216 [02/03/2021-16:09:28] [V] [TRT] Tactic: 7 time 0.01702 [02/03/2021-16:09:28] [V] [TRT] Tactic: 8 time 0.04348 [02/03/2021-16:09:28] [V] [TRT] Tactic: 9 time 0.025276 [02/03/2021-16:09:28] [V] [TRT] Tactic: 10 time 0.008248 [02/03/2021-16:09:28] [V] [TRT] Tactic: 11 time 0.007684 [02/03/2021-16:09:28] [V] [TRT] Tactic: 12 time 0.01072 [02/03/2021-16:09:28] [V] [TRT] Tactic: 13 time 0.009136 [02/03/2021-16:09:28] [V] [TRT] Tactic: 14 time 0.015632 [02/03/2021-16:09:28] [V] [TRT] Tactic: 15 time 0.01146 [02/03/2021-16:09:28] [V] [TRT] Tactic: 16 time 0.024756 [02/03/2021-16:09:28] [V] [TRT] Tactic: 17 time 0.016844 [02/03/2021-16:09:28] [V] [TRT] Tactic: 18 time 0.043304 [02/03/2021-16:09:28] [V] [TRT] Tactic: 19 time 0.024728 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: -4 Time: 0.007136 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaGroupConvolution) [02/03/2021-16:09:28] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4 [02/03/2021-16:09:28] [V] [TRT] [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.012428 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.020648 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.012428 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015304 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.004492 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004492 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.014432 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.014048 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.014048 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.01436 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.009296 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.009296 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015424 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.01002 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.01002 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015496 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.016956 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.015496 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015476 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.006024 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.006024 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015852 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.020364 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.015852 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.0154 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.004532 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004532 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015464 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.008664 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.008664 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.01548 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.020516 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.01548 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015456 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.00608 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00608 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015212 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.004548 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004548 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.014536 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.01412 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.01412 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.014452 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.009296 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.009296 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015536 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.009868 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.009868 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.01554 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.01694 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.01554 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015464 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.006124 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.006124 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015628 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.004496 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.004496 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015464 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.009068 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.009068 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:28] [V] [TRT] Tactic: 1002 time 0.015556 [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.005848 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.005848 [02/03/2021-16:09:28] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,36864) -> Float(1,32,768,36864) *************** [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [02/03/2021-16:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 1825138533642645384 time 0.125668 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 2775507031594384867 time 0.041984 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 2842488832350522458 time 0.092572 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 3915320020053085238 time 0.123 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 6448355332020552203 time 0.125304 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: 6808617066150061604 time 0.086108 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: -8060443123034038864 time 0.093084 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: -4420849921117327522 time 0.070252 [02/03/2021-16:09:28] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:28] [V] [TRT] Tactic: -3946921629105938337 time 0.086864 [02/03/2021-16:09:28] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.041984 [02/03/2021-16:09:28] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaConvolution) [02/03/2021-16:09:28] [V] [TRT] Tactic: 0 time 0.047596 [02/03/2021-16:09:28] [V] [TRT] Tactic: 2 time 0.084916 [02/03/2021-16:09:29] [V] [TRT] Tactic: 5 time 0.443092 [02/03/2021-16:09:29] [V] [TRT] Tactic: 6 time 0.0447 [02/03/2021-16:09:29] [V] [TRT] Tactic: 57 time 0.047724 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 6 Time: 0.0447 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:29] [V] [TRT] [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Float(1,32,768,36864) *************** [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [02/03/2021-16:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 892787096507693407 time 0.067568 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1204440019753223942 time 0.056332 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1659301557717208403 time 0.049104 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2057291331119027912 time 0.055132 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3275977259705528576 time 0.054308 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 5623454780463195174 time 0.055 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 8930254200803946944 time 0.055672 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -9204333525109552344 time 0.05374 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -4973811344878172338 time 0.064536 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -1228371230285617088 time 0.066264 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1659301557717208403 Time: 0.049104 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaGroupConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1659301557717208403 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Int8(1,32,768:4,9216) *************** [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [02/03/2021-16:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 4438325421691896755 time 0.046944 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 4581732244273465060 time 0.043044 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 4934335053031119367 time 0.04922 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 6797040896965118050 time 0.05652 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: 8006952294591770973 time 0.046624 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -7210942453088153035 time 0.054956 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -6282183216199417697 time 0.042548 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -5026383765466876607 time 0.057168 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -5016725782072253841 time 0.045228 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Tactic: -1370999262391786833 time 0.04682 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: -6282183216199417697 Time: 0.042548 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaGroupConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6282183216199417697 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_13 + Relu_14 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [02/03/2021-16:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [02/03/2021-16:09:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaGroupConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [02/03/2021-16:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [02/03/2021-16:09:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_13 + Relu_14 (CudaGroupConvolution) [02/03/2021-16:09:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1002 time 0.012552 [02/03/2021-16:09:29] [V] [TRT] Tactic: 0 time 0.020428 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.012552 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1002 time 0.015772 [02/03/2021-16:09:29] [V] [TRT] Tactic: 0 time 0.020384 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.015772 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1002 time 0.01568 [02/03/2021-16:09:29] [V] [TRT] Tactic: 0 time 0.020544 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.01568 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,36864), Float(1,32,768,36864) -> Float(1,32,768,36864) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Add_15 (ElementWise) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1 time 0.006164 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2 time 0.009236 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1 Time: 0.006164 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Add_15 (ElementWise) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1 time 0.01082 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2 time 0.02358 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1 Time: 0.01082 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216), Int8(1,32,768:4,9216) -> Int8(1,32,768:4,9216) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Add_15 (ElementWise) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1 time 0.006108 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2 time 0.007256 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1 Time: 0.006108 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Add_15 (ElementWise) [02/03/2021-16:09:29] [V] [TRT] Tactic: 1 time 0.006112 [02/03/2021-16:09:29] [V] [TRT] Fastest Tactic: 1 Time: 0.006112 [02/03/2021-16:09:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,36864) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:29] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:29] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:29] [V] [TRT] Tactic: 524287 time 0.0689 [02/03/2021-16:09:29] [V] [TRT] Tactic: 720895 time 0.063648 [02/03/2021-16:09:29] [V] [TRT] Tactic: 983039 time 0.055732 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1048575 time 0.062756 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1703935 time 0.055784 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1769471 time 0.07264 [02/03/2021-16:09:29] [V] [TRT] Tactic: 1966079 time 0.0767 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2031615 time 0.091528 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2228223 time 0.06006 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2424831 time 0.053316 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2621439 time 0.060776 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2752511 time 0.070556 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2818047 time 0.11196 [02/03/2021-16:09:29] [V] [TRT] Tactic: 2883583 time 0.125936 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3014655 time 0.055268 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3145727 time 0.061128 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3473407 time 0.094792 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3604479 time 0.055352 [02/03/2021-16:09:29] [V] [TRT] Tactic: 3735551 time 0.094172 [02/03/2021-16:09:29] [V] [TRT] Tactic: 4390911 time 0.080716 [02/03/2021-16:09:29] [V] [TRT] Tactic: 5046271 time 0.057164 [02/03/2021-16:09:29] [V] [TRT] Tactic: 5963775 time 0.07208 [02/03/2021-16:09:29] [V] [TRT] Tactic: 6160383 time 0.06722 [02/03/2021-16:09:29] [V] [TRT] Tactic: 6488063 time 0.068928 [02/03/2021-16:09:29] [V] [TRT] Tactic: 6881279 time 0.083588 [02/03/2021-16:09:29] [V] [TRT] Tactic: 7274495 time 0.056568 [02/03/2021-16:09:29] [V] [TRT] Tactic: 7864319 time 0.061788 [02/03/2021-16:09:29] [V] [TRT] Tactic: 7995391 time 0.066108 [02/03/2021-16:09:29] [V] [TRT] Tactic: 8585215 time 0.075376 [02/03/2021-16:09:29] [V] [TRT] Tactic: 8847359 time 0.072932 [02/03/2021-16:09:29] [V] [TRT] Tactic: 8978431 time 0.07214 [02/03/2021-16:09:29] [V] [TRT] Tactic: 9043967 time 0.057572 [02/03/2021-16:09:29] [V] [TRT] Tactic: 9175039 time 0.055384 [02/03/2021-16:09:29] [V] [TRT] Tactic: 9502719 time 0.080952 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9830399 time 0.089248 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9961471 time 0.06954 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10027007 time 0.063032 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10092543 time 0.08082 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10289151 time 0.076864 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10485759 time 0.054924 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10682367 time 0.05268 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10813439 time 0.0532 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: 10682367 Time: 0.05268 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1825138533642645384 time 0.093504 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2775507031594384867 time 0.030884 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2842488832350522458 time 0.061364 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3915320020053085238 time 0.092044 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6448355332020552203 time 0.093836 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6808617066150061604 time 0.056096 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -8060443123034038864 time 0.063076 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -4420849921117327522 time 0.059552 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -3946921629105938337 time 0.096896 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.030884 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:30] [V] [TRT] Tactic: 0 time 0.084504 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2 time 0.143824 [02/03/2021-16:09:30] [V] [TRT] Tactic: 5 time 0.640272 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6 time 0.053992 [02/03/2021-16:09:30] [V] [TRT] Tactic: 57 time 0.285272 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: 6 Time: 0.053992 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:30] [V] [TRT] [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:30] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 892787096507693407 time 0.0329 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1204440019753223942 time 0.025468 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1659301557717208403 time 0.032888 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2057291331119027912 time 0.024724 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3275977259705528576 time 0.022656 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 5623454780463195174 time 0.034492 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 8930254200803946944 time 0.024172 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -9204333525109552344 time 0.022384 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -4973811344878172338 time 0.031488 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -1228371230285617088 time 0.033276 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: -9204333525109552344 Time: 0.022384 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaGroupConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:30] [V] [TRT] Tactic: 524287 time 0.020288 [02/03/2021-16:09:30] [V] [TRT] Tactic: 720895 time 0.021064 [02/03/2021-16:09:30] [V] [TRT] Tactic: 983039 time 0.0186 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1048575 time 0.021788 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1703935 time 0.021584 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1966079 time 0.0243 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2031615 time 0.03054 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2228223 time 0.023572 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2752511 time 0.023276 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2818047 time 0.036084 [02/03/2021-16:09:30] [V] [TRT] Tactic: 2883583 time 0.040256 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3014655 time 0.022856 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3145727 time 0.02198 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3473407 time 0.036156 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3604479 time 0.018556 [02/03/2021-16:09:30] [V] [TRT] Tactic: 3735551 time 0.028564 [02/03/2021-16:09:30] [V] [TRT] Tactic: 4390911 time 0.027948 [02/03/2021-16:09:30] [V] [TRT] Tactic: 5046271 time 0.020096 [02/03/2021-16:09:30] [V] [TRT] Tactic: 5963775 time 0.024496 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6160383 time 0.033656 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6488063 time 0.025792 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6881279 time 0.026856 [02/03/2021-16:09:30] [V] [TRT] Tactic: 7995391 time 0.021608 [02/03/2021-16:09:30] [V] [TRT] Tactic: 8585215 time 0.02622 [02/03/2021-16:09:30] [V] [TRT] Tactic: 8978431 time 0.021656 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9043967 time 0.021648 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9175039 time 0.018528 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9502719 time 0.02944 [02/03/2021-16:09:30] [V] [TRT] Tactic: 9830399 time 0.03148 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10027007 time 0.023324 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10092543 time 0.027752 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10289151 time 0.024272 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10485759 time 0.021208 [02/03/2021-16:09:30] [V] [TRT] Tactic: 10813439 time 0.017092 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: 10813439 Time: 0.017092 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 4438325421691896755 time 0.02188 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 4581732244273465060 time 0.020156 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 4934335053031119367 time 0.03104 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 6797040896965118050 time 0.030388 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 8006952294591770973 time 0.032184 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -7210942453088153035 time 0.02944 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -6282183216199417697 time 0.03032 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -5026383765466876607 time 0.03006 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -5016725782072253841 time 0.030492 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: -1370999262391786833 time 0.022348 [02/03/2021-16:09:30] [V] [TRT] Fastest Tactic: 4581732244273465060 Time: 0.020156 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaGroupConvolution) [02/03/2021-16:09:30] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439 [02/03/2021-16:09:30] [V] [TRT] [02/03/2021-16:09:30] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,9216) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:30] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:30] [V] [TRT] Tactic: 1213457772632185722 time 0.03086 [02/03/2021-16:09:30] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 1713441381477652893 time 0.032112 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 7125598890155666458 time 0.022228 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 8047041638267142825 time 0.030168 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -7846982807478255793 time 0.020028 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -6459719113600909000 time 0.029892 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -4573925292554651334 time 0.029304 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -3566249366964946311 time 0.021592 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -2002418013575043687 time 0.030336 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -1659631603542281459 time 0.030136 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: -7846982807478255793 Time: 0.020028 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaGroupConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:31] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaGroupConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (FusedConvActConvolution) [02/03/2021-16:09:31] [V] [TRT] Tactic: 524287 time 0.021032 [02/03/2021-16:09:31] [V] [TRT] Tactic: 720895 time 0.020092 [02/03/2021-16:09:31] [V] [TRT] Tactic: 983039 time 0.018104 [02/03/2021-16:09:31] [V] [TRT] Tactic: 1048575 time 0.021484 [02/03/2021-16:09:31] [V] [TRT] Tactic: 1703935 time 0.02124 [02/03/2021-16:09:31] [V] [TRT] Tactic: 1966079 time 0.022868 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2031615 time 0.028688 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2228223 time 0.027944 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2752511 time 0.022804 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2818047 time 0.03524 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2883583 time 0.039124 [02/03/2021-16:09:31] [V] [TRT] Tactic: 3014655 time 0.022604 [02/03/2021-16:09:31] [V] [TRT] Tactic: 3145727 time 0.021508 [02/03/2021-16:09:31] [V] [TRT] Tactic: 3473407 time 0.030316 [02/03/2021-16:09:31] [V] [TRT] Tactic: 3604479 time 0.018348 [02/03/2021-16:09:31] [V] [TRT] Tactic: 3735551 time 0.028304 [02/03/2021-16:09:31] [V] [TRT] Tactic: 4390911 time 0.027156 [02/03/2021-16:09:31] [V] [TRT] Tactic: 5046271 time 0.020524 [02/03/2021-16:09:31] [V] [TRT] Tactic: 5963775 time 0.021628 [02/03/2021-16:09:31] [V] [TRT] Tactic: 6160383 time 0.033272 [02/03/2021-16:09:31] [V] [TRT] Tactic: 6488063 time 0.025716 [02/03/2021-16:09:31] [V] [TRT] Tactic: 6881279 time 0.026248 [02/03/2021-16:09:31] [V] [TRT] Tactic: 7995391 time 0.020104 [02/03/2021-16:09:31] [V] [TRT] Tactic: 8585215 time 0.026592 [02/03/2021-16:09:31] [V] [TRT] Tactic: 8978431 time 0.021124 [02/03/2021-16:09:31] [V] [TRT] Tactic: 9043967 time 0.0216 [02/03/2021-16:09:31] [V] [TRT] Tactic: 9175039 time 0.01846 [02/03/2021-16:09:31] [V] [TRT] Tactic: 9502719 time 0.029512 [02/03/2021-16:09:31] [V] [TRT] Tactic: 9830399 time 0.029076 [02/03/2021-16:09:31] [V] [TRT] Tactic: 10027007 time 0.023832 [02/03/2021-16:09:31] [V] [TRT] Tactic: 10092543 time 0.027536 [02/03/2021-16:09:31] [V] [TRT] Tactic: 10289151 time 0.02278 [02/03/2021-16:09:31] [V] [TRT] Tactic: 10485759 time 0.021484 [02/03/2021-16:09:31] [V] [TRT] Tactic: 10813439 time 0.015976 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 10813439 Time: 0.015976 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CaskConvolution) [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 66319348402778770 time 0.016636 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 1931698692231796048 time 0.017832 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 2271687430539765460 time 0.023456 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: 7039764449991095921 time 0.016992 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -9114895246540757312 time 0.01702 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -8787970778927801941 time 0.017592 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -8225786209923559953 time 0.0239 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -7373087278866484214 time 0.017564 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -7274936339335021260 time 0.017812 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -2102888629196925141 time 0.015396 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -674235064782459186 time 0.02316 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Tactic: -182858804213663094 time 0.015604 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.015396 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaDepthwiseConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: Conv_16 + Relu_17 (CudaGroupConvolution) [02/03/2021-16:09:31] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] Conv_16 + Relu_17 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.012316 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.025312 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.012316 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.015468 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.005768 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005768 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.01452 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.01798 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.01452 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.018152 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.011372 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.011372 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.017028 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.012 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.015664 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.0211 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.015664 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.014696 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.006388 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006388 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.015108 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.025488 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.015108 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.015032 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.005276 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.005276 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.014692 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.009712 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.009712 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.014748 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.026016 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014748 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.015372 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.007504 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007504 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.0153 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.006072 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006072 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:31] [V] [TRT] Tactic: 1002 time 0.014376 [02/03/2021-16:09:31] [V] [TRT] Tactic: 0 time 0.017988 [02/03/2021-16:09:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.014376 [02/03/2021-16:09:31] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.018236 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.011468 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.011468 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.017152 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.011952 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.011952 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.015644 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.021056 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.015644 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.014732 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.006476 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006476 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.015424 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.005304 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.005304 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.015244 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.009712 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.009712 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:32] [V] [TRT] Tactic: 1002 time 0.015448 [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.007492 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.007492 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1825138533642645384 time 0.127256 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2842488832350522458 time 0.094456 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 3915320020053085238 time 0.121176 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 6448355332020552203 time 0.127092 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 6808617066150061604 time 0.083212 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -8060443123034038864 time 0.0992 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -4420849921117327522 time 0.102604 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -3946921629105938337 time 0.129424 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.083212 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] Tactic: 0 time 0.110704 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2 time 0.163112 [02/03/2021-16:09:32] [V] [TRT] Tactic: 57 time 0.119524 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 0 Time: 0.110704 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 892787096507693407 time 0.039936 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1204440019753223942 time 0.033084 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1659301557717208403 time 0.04024 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2057291331119027912 time 0.030124 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 3275977259705528576 time 0.02612 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 5623454780463195174 time 0.0443 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 8930254200803946944 time 0.02952 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -9204333525109552344 time 0.025784 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -4973811344878172338 time 0.038092 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -1228371230285617088 time 0.040356 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: -9204333525109552344 Time: 0.025784 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaGroupConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 4438325421691896755 time 0.028184 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 4581732244273465060 time 0.02332 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 4934335053031119367 time 0.03092 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 6797040896965118050 time 0.037276 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 8006952294591770973 time 0.041892 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -7210942453088153035 time 0.035616 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -6282183216199417697 time 0.037708 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -5026383765466876607 time 0.037728 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -5016725782072253841 time 0.023892 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -1370999262391786833 time 0.027948 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: 4581732244273465060 Time: 0.02332 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaGroupConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1213457772632185722 time 0.030192 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1713441381477652893 time 0.03268 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 7125598890155666458 time 0.027328 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 8047041638267142825 time 0.024924 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -7846982807478255793 time 0.023192 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -6459719113600909000 time 0.024048 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -4573925292554651334 time 0.03568 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -3566249366964946311 time 0.027816 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -2002418013575043687 time 0.037312 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -1659631603542281459 time 0.037776 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: -7846982807478255793 Time: 0.023192 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaGroupConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaGroupConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CaskConvolution) [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 66319348402778770 time 0.016952 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1931698692231796048 time 0.019116 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2271687430539765460 time 0.024116 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: 7039764449991095921 time 0.017156 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -9114895246540757312 time 0.017176 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -8787970778927801941 time 0.017548 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -8225786209923559953 time 0.023836 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -7373087278866484214 time 0.01768 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -7274936339335021260 time 0.018008 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -2102888629196925141 time 0.015508 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -674235064782459186 time 0.023136 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Tactic: -182858804213663094 time 0.015392 [02/03/2021-16:09:32] [V] [TRT] Fastest Tactic: -182858804213663094 Time: 0.015392 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaDepthwiseConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_18 + Relu_19 (CudaGroupConvolution) [02/03/2021-16:09:32] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -182858804213663094 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_18 + Relu_19 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:32] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:32] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:32] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:32] [V] [TRT] Tactic: 524287 time 0.08818 [02/03/2021-16:09:32] [V] [TRT] Tactic: 720895 time 0.081456 [02/03/2021-16:09:32] [V] [TRT] Tactic: 983039 time 0.069656 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1048575 time 0.075864 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1703935 time 0.07098 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1769471 time 0.091332 [02/03/2021-16:09:32] [V] [TRT] Tactic: 1966079 time 0.108596 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2031615 time 0.11874 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2228223 time 0.073828 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2424831 time 0.065984 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2621439 time 0.075244 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2752511 time 0.0887 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2818047 time 0.143776 [02/03/2021-16:09:32] [V] [TRT] Tactic: 2883583 time 0.164844 [02/03/2021-16:09:32] [V] [TRT] Tactic: 3014655 time 0.069692 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3145727 time 0.076924 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3473407 time 0.124476 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3604479 time 0.070044 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3735551 time 0.123744 [02/03/2021-16:09:33] [V] [TRT] Tactic: 4390911 time 0.115988 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5046271 time 0.080136 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5963775 time 0.103296 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6160383 time 0.084604 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6488063 time 0.08742 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6881279 time 0.106624 [02/03/2021-16:09:33] [V] [TRT] Tactic: 7274495 time 0.071028 [02/03/2021-16:09:33] [V] [TRT] Tactic: 7864319 time 0.076092 [02/03/2021-16:09:33] [V] [TRT] Tactic: 7995391 time 0.082616 [02/03/2021-16:09:33] [V] [TRT] Tactic: 8585215 time 0.094724 [02/03/2021-16:09:33] [V] [TRT] Tactic: 8847359 time 0.091256 [02/03/2021-16:09:33] [V] [TRT] Tactic: 8978431 time 0.103748 [02/03/2021-16:09:33] [V] [TRT] Tactic: 9043967 time 0.07292 [02/03/2021-16:09:33] [V] [TRT] Tactic: 9175039 time 0.06972 [02/03/2021-16:09:33] [V] [TRT] Tactic: 9502719 time 0.11514 [02/03/2021-16:09:33] [V] [TRT] Tactic: 9830399 time 0.11642 [02/03/2021-16:09:33] [V] [TRT] Tactic: 9961471 time 0.085536 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10027007 time 0.079776 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10092543 time 0.115676 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10289151 time 0.108492 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10485759 time 0.070828 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10682367 time 0.065508 [02/03/2021-16:09:33] [V] [TRT] Tactic: 10813439 time 0.066468 [02/03/2021-16:09:33] [V] [TRT] Fastest Tactic: 10682367 Time: 0.065508 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1825138533642645384 time 0.124012 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2775507031594384867 time 0.038144 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2842488832350522458 time 0.091468 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3915320020053085238 time 0.120784 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6448355332020552203 time 0.123388 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6808617066150061604 time 0.083692 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -8060443123034038864 time 0.09304 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -4420849921117327522 time 0.098508 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -3946921629105938337 time 0.13024 [02/03/2021-16:09:33] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.038144 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:33] [V] [TRT] Tactic: 0 time 0.10976 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2 time 0.16486 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5 skipped. Scratch requested: 18939904, available: 16777216 [02/03/2021-16:09:33] [V] [TRT] Tactic: 6 time 0.062144 [02/03/2021-16:09:33] [V] [TRT] Tactic: 57 time 0.117648 [02/03/2021-16:09:33] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [02/03/2021-16:09:33] [V] [TRT] Fastest Tactic: 6 Time: 0.062144 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:33] [V] [TRT] [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [02/03/2021-16:09:33] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 892787096507693407 time 0.039004 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1204440019753223942 time 0.029932 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1659301557717208403 time 0.040188 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2057291331119027912 time 0.028332 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3275977259705528576 time 0.025996 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5623454780463195174 time 0.042796 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: 8930254200803946944 time 0.028516 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -9204333525109552344 time 0.025732 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -4973811344878172338 time 0.037864 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Tactic: -1228371230285617088 time 0.039412 [02/03/2021-16:09:33] [V] [TRT] Fastest Tactic: -9204333525109552344 Time: 0.025732 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaGroupConvolution) [02/03/2021-16:09:33] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:33] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:33] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:33] [V] [TRT] Tactic: 524287 time 0.024128 [02/03/2021-16:09:33] [V] [TRT] Tactic: 720895 time 0.024928 [02/03/2021-16:09:33] [V] [TRT] Tactic: 983039 time 0.0217 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1048575 time 0.026284 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1703935 time 0.029512 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1769471 time 0.036344 [02/03/2021-16:09:33] [V] [TRT] Tactic: 1966079 time 0.031564 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2031615 time 0.042 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2228223 time 0.038272 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2424831 time 0.037976 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2621439 time 0.031108 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2752511 time 0.032204 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2818047 time 0.050148 [02/03/2021-16:09:33] [V] [TRT] Tactic: 2883583 time 0.055224 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3014655 time 0.030364 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3145727 time 0.029684 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3473407 time 0.04254 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3604479 time 0.024832 [02/03/2021-16:09:33] [V] [TRT] Tactic: 3735551 time 0.040836 [02/03/2021-16:09:33] [V] [TRT] Tactic: 4390911 time 0.038032 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5046271 time 0.028044 [02/03/2021-16:09:33] [V] [TRT] Tactic: 5963775 time 0.032928 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6160383 time 0.047556 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6488063 time 0.0354 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6881279 time 0.036968 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7274495 time 0.026796 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7864319 time 0.03234 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7995391 time 0.02818 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8585215 time 0.036168 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8847359 time 0.031748 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8978431 time 0.029832 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9043967 time 0.029636 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9175039 time 0.024896 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9502719 time 0.041296 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9830399 time 0.043932 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9961471 time 0.039752 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10027007 time 0.032556 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10092543 time 0.038024 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10289151 time 0.031484 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10485759 time 0.029276 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10682367 time 0.025048 [02/03/2021-16:09:34] [V] [TRT] Tactic: 10813439 time 0.023092 [02/03/2021-16:09:34] [V] [TRT] Fastest Tactic: 983039 Time: 0.0217 [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 4438325421691896755 time 0.029888 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 4581732244273465060 time 0.026416 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 4934335053031119367 time 0.04304 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6797040896965118050 time 0.041612 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8006952294591770973 time 0.046824 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -7210942453088153035 time 0.04106 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -6282183216199417697 time 0.04272 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -5026383765466876607 time 0.041704 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -5016725782072253841 time 0.042856 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -1370999262391786833 time 0.033608 [02/03/2021-16:09:34] [V] [TRT] Fastest Tactic: 4581732244273465060 Time: 0.026416 [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaGroupConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [02/03/2021-16:09:34] [V] [TRT] [02/03/2021-16:09:34] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1213457772632185722 time 0.049164 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1713441381477652893 time 0.05308 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7125598890155666458 time 0.033396 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8047041638267142825 time 0.049648 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -7846982807478255793 time 0.030564 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -6459719113600909000 time 0.048172 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -4573925292554651334 time 0.04686 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -3566249366964946311 time 0.03354 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -2002418013575043687 time 0.047976 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Tactic: -1659631603542281459 time 0.048176 [02/03/2021-16:09:34] [V] [TRT] Fastest Tactic: -7846982807478255793 Time: 0.030564 [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaGroupConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:34] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaGroupConvolution) [02/03/2021-16:09:34] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:34] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:34] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:34] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (FusedConvActConvolution) [02/03/2021-16:09:34] [V] [TRT] Tactic: 524287 time 0.032372 [02/03/2021-16:09:34] [V] [TRT] Tactic: 720895 time 0.031304 [02/03/2021-16:09:34] [V] [TRT] Tactic: 983039 time 0.027716 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1048575 time 0.034156 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1703935 time 0.033164 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1769471 time 0.04026 [02/03/2021-16:09:34] [V] [TRT] Tactic: 1966079 time 0.034856 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2031615 time 0.046428 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2228223 time 0.045212 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2424831 time 0.043656 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2621439 time 0.033428 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2752511 time 0.036496 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2818047 time 0.057632 [02/03/2021-16:09:34] [V] [TRT] Tactic: 2883583 time 0.064456 [02/03/2021-16:09:34] [V] [TRT] Tactic: 3014655 time 0.03484 [02/03/2021-16:09:34] [V] [TRT] Tactic: 3145727 time 0.033192 [02/03/2021-16:09:34] [V] [TRT] Tactic: 3473407 time 0.048664 [02/03/2021-16:09:34] [V] [TRT] Tactic: 3604479 time 0.028456 [02/03/2021-16:09:34] [V] [TRT] Tactic: 3735551 time 0.046756 [02/03/2021-16:09:34] [V] [TRT] Tactic: 4390911 time 0.043372 [02/03/2021-16:09:34] [V] [TRT] Tactic: 5046271 time 0.03276 [02/03/2021-16:09:34] [V] [TRT] Tactic: 5963775 time 0.033428 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6160383 time 0.054672 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6488063 time 0.041156 [02/03/2021-16:09:34] [V] [TRT] Tactic: 6881279 time 0.041268 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7274495 time 0.02952 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7864319 time 0.036592 [02/03/2021-16:09:34] [V] [TRT] Tactic: 7995391 time 0.031172 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8585215 time 0.042236 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8847359 time 0.035344 [02/03/2021-16:09:34] [V] [TRT] Tactic: 8978431 time 0.032332 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9043967 time 0.032992 [02/03/2021-16:09:34] [V] [TRT] Tactic: 9175039 time 0.028492 [02/03/2021-16:09:35] [V] [TRT] Tactic: 9502719 time 0.048136 [02/03/2021-16:09:35] [V] [TRT] Tactic: 9830399 time 0.04626 [02/03/2021-16:09:35] [V] [TRT] Tactic: 9961471 time 0.048612 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10027007 time 0.037556 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10092543 time 0.04356 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10289151 time 0.034952 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10485759 time 0.033364 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10682367 time 0.028092 [02/03/2021-16:09:35] [V] [TRT] Tactic: 10813439 time 0.02436 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 10813439 Time: 0.02436 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 66319348402778770 time 0.020932 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1931698692231796048 time 0.023036 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2271687430539765460 time 0.0312 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 7039764449991095921 time 0.022104 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -9114895246540757312 time 0.0224 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -8787970778927801941 time 0.0225 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -8225786209923559953 time 0.031592 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -7373087278866484214 time 0.022876 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -7274936339335021260 time 0.0229 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -2102888629196925141 time 0.0207 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -674235064782459186 time 0.031164 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -182858804213663094 time 0.020712 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.0207 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_20 + Relu_21 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_20 + Relu_21 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1002 time 0.015816 [02/03/2021-16:09:35] [V] [TRT] Tactic: 0 time 0.033444 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.015816 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1002 time 0.01938 [02/03/2021-16:09:35] [V] [TRT] Tactic: 0 time 0.033348 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.01938 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: (Reformat) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1002 time 0.019516 [02/03/2021-16:09:35] [V] [TRT] Tactic: 0 time 0.034096 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.019516 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_22 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.012184 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.0272 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.012184 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_22 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.012452 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.027124 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.012452 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_22 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.008588 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.008596 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.008588 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_22 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.008648 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.008648 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_23 + Relu_24 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_23 + Relu_24 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_23 + Relu_24 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_23 + Relu_24 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_23 + Relu_24 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_25 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.012244 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.02694 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.012244 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_25 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.012336 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.026988 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.012336 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_25 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.008476 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.008528 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.008476 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Add_25 (ElementWise) [02/03/2021-16:09:35] [V] [TRT] Tactic: 1 time 0.008564 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 1 Time: 0.008564 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1825138533642645384 time 0.181624 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2842488832350522458 time 0.130192 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 3915320020053085238 time 0.160144 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 6448355332020552203 time 0.18382 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 6808617066150061604 time 0.103836 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -8060443123034038864 time 0.1398 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -4420849921117327522 time 0.143712 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -3946921629105938337 time 0.168392 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.103836 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] Tactic: 0 time 0.143572 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2 time 0.203652 [02/03/2021-16:09:35] [V] [TRT] Tactic: 57 time 0.15558 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 0 Time: 0.143572 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 892787096507693407 time 0.056244 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1204440019753223942 time 0.05772 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1659301557717208403 time 0.053028 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2057291331119027912 time 0.043936 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 3275977259705528576 time 0.034248 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 5623454780463195174 time 0.063176 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 8930254200803946944 time 0.0426 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -9204333525109552344 time 0.033392 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -4973811344878172338 time 0.050088 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -1228371230285617088 time 0.056716 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: -9204333525109552344 Time: 0.033392 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9204333525109552344 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 4438325421691896755 time 0.041372 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 4581732244273465060 time 0.031292 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 4934335053031119367 time 0.058816 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 6797040896965118050 time 0.053544 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 8006952294591770973 time 0.059948 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -7210942453088153035 time 0.046996 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -6282183216199417697 time 0.049924 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -5026383765466876607 time 0.053788 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -5016725782072253841 time 0.04864 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -1370999262391786833 time 0.038868 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: 4581732244273465060 Time: 0.031292 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4581732244273465060 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1213457772632185722 time 0.047044 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1713441381477652893 time 0.05996 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 7125598890155666458 time 0.038832 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 8047041638267142825 time 0.0496 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -7846982807478255793 time 0.031164 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -6459719113600909000 time 0.048688 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -4573925292554651334 time 0.046956 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -3566249366964946311 time 0.040804 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -2002418013575043687 time 0.05362 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -1659631603542281459 time 0.053832 [02/03/2021-16:09:35] [V] [TRT] Fastest Tactic: -7846982807478255793 Time: 0.031164 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7846982807478255793 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (icudnn) Set Tactic Name: volta_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaGroupConvolution) [02/03/2021-16:09:35] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (FusedConvActConvolution) [02/03/2021-16:09:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:35] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CaskConvolution) [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 66319348402778770 time 0.02246 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 1931698692231796048 time 0.025556 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 2271687430539765460 time 0.0314 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: 7039764449991095921 time 0.022448 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -9114895246540757312 time 0.024312 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -8787970778927801941 time 0.022844 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:35] [V] [TRT] Tactic: -8225786209923559953 time 0.031756 [02/03/2021-16:09:35] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Tactic: -7373087278866484214 time 0.02464 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Tactic: -7274936339335021260 time 0.024644 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Tactic: -2102888629196925141 time 0.020804 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Tactic: -674235064782459186 time 0.03122 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Tactic: -182858804213663094 time 0.020844 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: -2102888629196925141 Time: 0.020804 [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_26 + Relu_27 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2102888629196925141 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] Conv_26 + Relu_27 (i8816cudnn) Set Tactic Name: volta_int8_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (FusedConvActConvolution) [02/03/2021-16:09:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CaskConvolution) [02/03/2021-16:09:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_28 + Relu_29 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_30 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.012 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.026592 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.012 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_30 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.012 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.027076 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.012 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_30 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.00842 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.008576 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.00842 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_30 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.008468 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.008468 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (FusedConvActConvolution) [02/03/2021-16:09:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CaskConvolution) [02/03/2021-16:09:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_31 + Relu_32 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_33 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.01206 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.026992 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.01206 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_33 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.012096 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.027188 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.012096 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_33 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.008636 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.008624 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 2 Time: 0.008624 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_33 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.008664 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.008664 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_34 + Relu_35 (FusedConvActConvolution) [02/03/2021-16:09:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_34 + Relu_35 (CaskConvolution) [02/03/2021-16:09:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_34 + Relu_35 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_34 + Relu_35 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_34 + Relu_35 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_36 + Relu_37 (FusedConvActConvolution) [02/03/2021-16:09:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_36 + Relu_37 (CaskConvolution) [02/03/2021-16:09:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_36 + Relu_37 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_36 + Relu_37 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_36 + Relu_37 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_38 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.012136 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.026984 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.012136 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_38 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.012076 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.027036 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.012076 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_38 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.008676 [02/03/2021-16:09:36] [V] [TRT] Tactic: 2 time 0.008672 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 2 Time: 0.008672 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Add_38 (ElementWise) [02/03/2021-16:09:36] [V] [TRT] Tactic: 1 time 0.008668 [02/03/2021-16:09:36] [V] [TRT] Fastest Tactic: 1 Time: 0.008668 [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (FusedConvActConvolution) [02/03/2021-16:09:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CaskConvolution) [02/03/2021-16:09:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CudaConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CudaDepthwiseConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] --------------- Timing Runner: Conv_39 + Relu_40 (CudaGroupConvolution) [02/03/2021-16:09:36] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) *************** [02/03/2021-16:09:36] [V] [TRT] *************** Autotuning format combination: Float(1,32,768,49152), Float(1,32,768,49152), Float(1,32,768,49152), Float(1,32,768,49152), Float(1,32,768,49152), Float(1,32,768,49152), Float(1,32,768,49152) -> Float(1,32,768,49152) *************** [02/03/2021-16:09:42] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44), Add_45), Add_46) (PointWiseV2) [02/03/2021-16:09:42] [V] [TRT] Tactic: 0 time 0.068224 [02/03/2021-16:09:42] [V] [TRT] Tactic: 1 time 0.069108 [02/03/2021-16:09:42] [V] [TRT] Tactic: 2 time 0.068348 [02/03/2021-16:09:42] [V] [TRT] Tactic: 3 time 0.07092 [02/03/2021-16:09:42] [V] [TRT] Tactic: 4 time 0.070392 [02/03/2021-16:09:42] [V] [TRT] Tactic: 5 time 0.069652 [02/03/2021-16:09:42] [V] [TRT] Tactic: 6 time 0.07334 [02/03/2021-16:09:42] [V] [TRT] Tactic: 7 time 0.072944 [02/03/2021-16:09:42] [V] [TRT] Tactic: 8 time 0.075136 [02/03/2021-16:09:42] [V] [TRT] Tactic: 9 time 0.073848 [02/03/2021-16:09:42] [V] [TRT] Tactic: 28 time 0.073588 [02/03/2021-16:09:42] [V] [TRT] Fastest Tactic: 0 Time: 0.068224 [02/03/2021-16:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [02/03/2021-16:09:42] [V] [TRT] [02/03/2021-16:09:42] [V] [TRT] *************** Autotuning format combination: Float(1,32,768:32,1536), Float(1,32,768:32,1536), Float(1,32,768:32,1536), Float(1,32,768:32,1536), Float(1,32,768:32,1536), Float(1,32,768:32,1536), Float(1,32,768:32,1536) -> Float(1,32,768:32,1536) *************** [02/03/2021-16:09:45] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44), Add_45), Add_46) (PointWiseV2) [02/03/2021-16:09:45] [V] [TRT] Tactic: 24 time 0.145032 [02/03/2021-16:09:45] [V] [TRT] Tactic: 25 time 0.133512 [02/03/2021-16:09:45] [V] [TRT] Tactic: 26 time 0.128508 [02/03/2021-16:09:45] [V] [TRT] Tactic: 27 time 0.125068 [02/03/2021-16:09:45] [V] [TRT] Tactic: 31 time 0.143752 [02/03/2021-16:09:45] [V] [TRT] Fastest Tactic: 27 Time: 0.125068 [02/03/2021-16:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [02/03/2021-16:09:45] [V] [TRT] [02/03/2021-16:09:45] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:4,12288), Int8(1,32,768:4,12288), Int8(1,32,768:4,12288), Int8(1,32,768:4,12288), Int8(1,32,768:4,12288), Int8(1,32,768:4,12288), Int8(1,32,768:4,12288) -> Int8(1,32,768:4,12288) *************** [02/03/2021-16:10:03] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(PWN(PWN(Add_41, Add_42), Add_43), Add_44), Add_45), Add_46) (PointWiseV2) [02/03/2021-16:10:03] [V] [TRT] Tactic: 0 time 0.057212 [02/03/2021-16:10:03] [V] [TRT] Tactic: 1 time 0.055464 [02/03/2021-16:10:03] [V] [TRT] Tactic: 2 time 0.059144 [02/03/2021-16:10:03] [V] [TRT] Tactic: 3 time 0.058008 [02/03/2021-16:10:03] [V] [TRT] Tactic: 4 time 0.058272 [02/03/2021-16:10:03] [V] [TRT] Tactic: 5 time 0.065936 [02/03/2021-16:10:03] [V] [TRT] Tactic: 6 time 0.068624 [02/03/2021-16:10:03] [V] [TRT] Tactic: 7 time 0.062084 [02/03/2021-16:10:03] [V] [TRT] Tactic: 8 time 0.072328 [02/03/2021-16:10:03] [V] [TRT] Tactic: 9 time 0.104056 [02/03/2021-16:10:03] [V] [TRT] Tactic: 10 time 0.064536 [02/03/2021-16:10:03] [V] [TRT] Tactic: 11 time 0.072932 [02/03/2021-16:10:03] [V] [TRT] Tactic: 12 time 0.069892 [02/03/2021-16:10:03] [V] [TRT] Tactic: 13 time 0.062744 [02/03/2021-16:10:03] [V] [TRT] Tactic: 14 time 0.074092 [02/03/2021-16:10:03] [V] [TRT] Tactic: 15 time 0.083196 [02/03/2021-16:10:03] [V] [TRT] Tactic: 16 time 0.068088 [02/03/2021-16:10:03] [V] [TRT] Tactic: 17 time 0.07732 [02/03/2021-16:10:03] [V] [TRT] Tactic: 18 time 0.078976 [02/03/2021-16:10:03] [V] [TRT] Tactic: 19 time 0.084088 [02/03/2021-16:10:03] [V] [TRT] Tactic: 20 time 0.072308 [02/03/2021-16:10:03] [V] [TRT] Tactic: 21 time 0.06682 [02/03/2021-16:10:03] [V] [TRT] Tactic: 22 time 0.056064 [02/03/2021-16:10:03] [V] [TRT] Tactic: 23 time 0.052224 [02/03/2021-16:10:03] [V] [TRT] Tactic: 28 time 0.095124 [02/03/2021-16:10:03] [V] [TRT] Tactic: 29 time 0.086408 [02/03/2021-16:10:03] [V] [TRT] Tactic: 30 time 0.072584 [02/03/2021-16:10:03] [V] [TRT] Fastest Tactic: 23 Time: 0.052224 [02/03/2021-16:10:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23 [02/03/2021-16:10:03] [V] [TRT] [02/03/2021-16:10:03] [V] [TRT] *************** Autotuning format combination: Int8(1,32,768:32,1536), Int8(1,32,768:32,1536), Int8(1,32,768:32,1536), Int8(1,32,768:32,1536), Int8(1,32,768:32,1536), Int8(1,32,768:32,1536), Int8(1,32,768:32,1536) -> Int8(1,32,768:32,1536) ***************