&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /./usr/src/tensorrt/bin/trtexec --explicitBatch --onnx=/home/nvidia/repos/vaerloese_128x128_2021-09-21.onnx --saveEngine=model.engine --workspace=16000 --buildOnly --shapes=inputs:160x128x128x3 --verbose [11/01/2021-13:38:33] [I] === Model Options === [11/01/2021-13:38:33] [I] Format: ONNX [11/01/2021-13:38:33] [I] Model: /home/nvidia/repos/vaerloese_128x128_2021-09-21.onnx [11/01/2021-13:38:33] [I] Output: [11/01/2021-13:38:33] [I] === Build Options === [11/01/2021-13:38:33] [I] Max batch: explicit [11/01/2021-13:38:33] [I] Workspace: 16000 MiB [11/01/2021-13:38:33] [I] minTiming: 1 [11/01/2021-13:38:33] [I] avgTiming: 8 [11/01/2021-13:38:33] [I] Precision: FP32 [11/01/2021-13:38:33] [I] Calibration: [11/01/2021-13:38:33] [I] Refit: Disabled [11/01/2021-13:38:33] [I] Sparsity: Disabled [11/01/2021-13:38:33] [I] Safe mode: Disabled [11/01/2021-13:38:33] [I] Restricted mode: Disabled [11/01/2021-13:38:33] [I] Save engine: model.engine [11/01/2021-13:38:33] [I] Load engine: [11/01/2021-13:38:33] [I] NVTX verbosity: 0 [11/01/2021-13:38:33] [I] Tactic sources: Using default tactic sources [11/01/2021-13:38:33] [I] timingCacheMode: local [11/01/2021-13:38:33] [I] timingCacheFile: [11/01/2021-13:38:33] [I] Input(s)s format: fp32:CHW [11/01/2021-13:38:33] [I] Output(s)s format: fp32:CHW [11/01/2021-13:38:33] [I] Input build shape: inputs=160x128x128x3+160x128x128x3+160x128x128x3 [11/01/2021-13:38:33] [I] Input calibration shapes: model [11/01/2021-13:38:33] [I] === System Options === [11/01/2021-13:38:33] [I] Device: 0 [11/01/2021-13:38:33] [I] DLACore: [11/01/2021-13:38:33] [I] Plugins: [11/01/2021-13:38:33] [I] === Inference Options === [11/01/2021-13:38:33] [I] Batch: Explicit [11/01/2021-13:38:33] [I] Input inference shape: inputs=160x128x128x3 [11/01/2021-13:38:33] [I] Iterations: 10 [11/01/2021-13:38:33] [I] Duration: 3s (+ 200ms warm up) [11/01/2021-13:38:33] [I] Sleep time: 0ms [11/01/2021-13:38:33] [I] Streams: 1 [11/01/2021-13:38:33] [I] ExposeDMA: Disabled [11/01/2021-13:38:33] [I] Data transfers: Enabled [11/01/2021-13:38:33] [I] Spin-wait: Disabled [11/01/2021-13:38:33] [I] Multithreading: Disabled [11/01/2021-13:38:33] [I] CUDA Graph: Disabled [11/01/2021-13:38:33] [I] Separate profiling: Disabled [11/01/2021-13:38:33] [I] Time Deserialize: Disabled [11/01/2021-13:38:33] [I] Time Refit: Disabled [11/01/2021-13:38:33] [I] Skip inference: Enabled [11/01/2021-13:38:33] [I] Inputs: [11/01/2021-13:38:33] [I] === Reporting Options === [11/01/2021-13:38:33] [I] Verbose: Enabled [11/01/2021-13:38:33] [I] Averages: 10 inferences [11/01/2021-13:38:33] [I] Percentile: 99 [11/01/2021-13:38:33] [I] Dump refittable layers:Disabled [11/01/2021-13:38:33] [I] Dump output: Disabled [11/01/2021-13:38:33] [I] Profile: Disabled [11/01/2021-13:38:33] [I] Export timing to JSON file: [11/01/2021-13:38:33] [I] Export output to JSON file: [11/01/2021-13:38:33] [I] Export profile to JSON file: [11/01/2021-13:38:33] [I] [11/01/2021-13:38:33] [I] === Device Information === [11/01/2021-13:38:33] [I] Selected Device: Xavier [11/01/2021-13:38:33] [I] Compute Capability: 7.2 [11/01/2021-13:38:33] [I] SMs: 8 [11/01/2021-13:38:33] [I] Compute Clock Rate: 1.377 GHz [11/01/2021-13:38:33] [I] Device Global Memory: 31928 MiB [11/01/2021-13:38:33] [I] Shared Memory per SM: 96 KiB [11/01/2021-13:38:33] [I] Memory Bus Width: 256 bits (ECC disabled) [11/01/2021-13:38:33] [I] Memory Clock Rate: 1.377 GHz [11/01/2021-13:38:33] [I] [11/01/2021-13:38:33] [I] TensorRT version: 8001 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Proposal version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::Split version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [11/01/2021-13:38:33] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [11/01/2021-13:38:34] [I] [TRT] [MemUsageChange] Init CUDA: CPU +354, GPU +0, now: CPU 372, GPU 6000 (MiB) [11/01/2021-13:38:34] [I] Start parsing network model [11/01/2021-13:38:34] [I] [TRT] ---------------------------------------------------------------- [11/01/2021-13:38:34] [I] [TRT] Input filename: /home/nvidia/repos/vaerloese_128x128_2021-09-21.onnx [11/01/2021-13:38:34] [I] [TRT] ONNX IR version: 0.0.4 [11/01/2021-13:38:34] [I] [TRT] Opset version: 9 [11/01/2021-13:38:34] [I] [TRT] Producer name: keras2onnx [11/01/2021-13:38:34] [I] [TRT] Producer version: 1.8.1 [11/01/2021-13:38:34] [I] [TRT] Domain: onnxmltools [11/01/2021-13:38:34] [I] [TRT] Model version: 0 [11/01/2021-13:38:34] [I] [TRT] Doc string: [11/01/2021-13:38:34] [I] [TRT] ---------------------------------------------------------------- [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::Split version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [11/01/2021-13:38:34] [V] [TRT] Adding network input: inputs with dtype: float32, dimensions: (-1, 128, 128, 3) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: inputs for ONNX tensor: inputs [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_4/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_4/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_3/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_3/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale1 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias1 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean1 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var1 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_2/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_2/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale2 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias2 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean2 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var2 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_1/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose_1/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale3 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias3 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean3 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var3 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_transpose/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale4 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias4 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean4 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var4 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_4/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_4/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale5 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias5 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean5 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var5 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_3/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_3/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale6 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias6 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean6 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var6 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_2/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_2/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale7 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias7 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean7 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var7 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_1/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d_1/bias:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: scale8 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: bias8 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: mean8 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: var8 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Importing initializer: conv2d/bias:0 [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity4 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: inputs [11/01/2021-13:38:34] [V] [TRT] Identity4 [Identity] inputs: [inputs -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity4 for ONNX node: Identity4 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: inputs:0 for ONNX tensor: inputs:0 [11/01/2021-13:38:34] [V] [TRT] Identity4 [Identity] outputs: [inputs:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity31 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: inputs:0 [11/01/2021-13:38:34] [V] [TRT] Identity31 [Identity] inputs: [inputs:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity31 for ONNX node: Identity31 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: inputs:01 for ONNX tensor: inputs:01 [11/01/2021-13:38:34] [V] [TRT] Identity31 [Identity] outputs: [inputs:01 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose36 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: inputs:01 [11/01/2021-13:38:34] [V] [TRT] Transpose36 [Transpose] inputs: [inputs:01 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose36 for ONNX node: Transpose36 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input9 for ONNX tensor: adjusted_input9 [11/01/2021-13:38:34] [V] [TRT] Transpose36 [Transpose] outputs: [adjusted_input9 -> (-1, 3, 128, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d [Conv] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input9 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d [Conv] inputs: [adjusted_input9 -> (-1, 3, 128, 128)[FLOAT]], [conv2d/kernel:0 -> (128, 3, 5, 5)[FLOAT]], [conv2d/bias:0 -> (128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Convolution input dimensions: (-1, 3, 128, 128) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d for ONNX node: conv2d [11/01/2021-13:38:34] [V] [TRT] Using kernel: (5, 5), strides: (2, 2), prepadding: (1, 1), postpadding: (2, 2), dilations: (1, 1), numOutputs: 128 [11/01/2021-13:38:34] [V] [TRT] Convolution output dimensions: (-1, 128, 64, 64) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output9 for ONNX tensor: convolution_output9 [11/01/2021-13:38:34] [V] [TRT] conv2d [Conv] outputs: [convolution_output9 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose37 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output9 [11/01/2021-13:38:34] [V] [TRT] Transpose37 [Transpose] inputs: [convolution_output9 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose37 for ONNX node: Transpose37 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output9 for ONNX tensor: transpose_output9 [11/01/2021-13:38:34] [V] [TRT] Transpose37 [Transpose] outputs: [transpose_output9 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity30 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output9 [11/01/2021-13:38:34] [V] [TRT] Identity30 [Identity] inputs: [transpose_output9 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity30 for ONNX node: Identity30 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d/BiasAdd:0 for ONNX tensor: conv2d/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity30 [Identity] outputs: [conv2d/BiasAdd:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose34 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose34 [Transpose] inputs: [conv2d/BiasAdd:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose34 for ONNX node: Transpose34 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d/BiasAdd:0_transposed for ONNX tensor: conv2d/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose34 [Transpose] outputs: [conv2d/BiasAdd:0_transposed -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale8 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias8 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean8 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var8 [11/01/2021-13:38:34] [V] [TRT] batch_normalization [BatchNormalization] inputs: [conv2d/BiasAdd:0_transposed -> (-1, 128, 64, 64)[FLOAT]], [scale8 -> (128)[FLOAT]], [bias8 -> (128)[FLOAT]], [mean8 -> (128)[FLOAT]], [var8 -> (128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization for ONNX node: batch_normalization [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer8 for ONNX tensor: batch_norm_output_buffer8 [11/01/2021-13:38:34] [V] [TRT] batch_normalization [BatchNormalization] outputs: [batch_norm_output_buffer8 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose35 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer8 [11/01/2021-13:38:34] [V] [TRT] Transpose35 [Transpose] inputs: [batch_norm_output_buffer8 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose35 for ONNX node: Transpose35 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization/cond/Identity:0 for ONNX tensor: batch_normalization/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose35 [Transpose] outputs: [batch_normalization/cond/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity29 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity29 [Identity] inputs: [batch_normalization/cond/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity29 for ONNX node: Identity29 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization/activity_regularization/Identity:0 for ONNX tensor: activity_regularization/activity_regularization/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity29 [Identity] outputs: [activity_regularization/activity_regularization/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization/activity_regularization/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu [Elu] inputs: [activity_regularization/activity_regularization/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu for ONNX node: elu [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu/Elu:0 for ONNX tensor: elu/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu [Elu] outputs: [elu/Elu:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose32 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Transpose32 [Transpose] inputs: [elu/Elu:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose32 for ONNX node: Transpose32 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input8 for ONNX tensor: adjusted_input8 [11/01/2021-13:38:34] [V] [TRT] Transpose32 [Transpose] outputs: [adjusted_input8 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_1 [Conv] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input8 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_1/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_1/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_1 [Conv] inputs: [adjusted_input8 -> (-1, 128, 64, 64)[FLOAT]], [conv2d_1/kernel:0 -> (192, 128, 5, 5)[FLOAT]], [conv2d_1/bias:0 -> (192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Convolution input dimensions: (-1, 128, 64, 64) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_1 for ONNX node: conv2d_1 [11/01/2021-13:38:34] [V] [TRT] Using kernel: (5, 5), strides: (2, 2), prepadding: (1, 1), postpadding: (2, 2), dilations: (1, 1), numOutputs: 192 [11/01/2021-13:38:34] [V] [TRT] Convolution output dimensions: (-1, 192, 32, 32) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output8 for ONNX tensor: convolution_output8 [11/01/2021-13:38:34] [V] [TRT] conv2d_1 [Conv] outputs: [convolution_output8 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose33 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output8 [11/01/2021-13:38:34] [V] [TRT] Transpose33 [Transpose] inputs: [convolution_output8 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose33 for ONNX node: Transpose33 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output8 for ONNX tensor: transpose_output8 [11/01/2021-13:38:34] [V] [TRT] Transpose33 [Transpose] outputs: [transpose_output8 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity28 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output8 [11/01/2021-13:38:34] [V] [TRT] Identity28 [Identity] inputs: [transpose_output8 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity28 for ONNX node: Identity28 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_1/BiasAdd:0 for ONNX tensor: conv2d_1/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity28 [Identity] outputs: [conv2d_1/BiasAdd:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose30 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_1/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose30 [Transpose] inputs: [conv2d_1/BiasAdd:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose30 for ONNX node: Transpose30 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_1/BiasAdd:0_transposed for ONNX tensor: conv2d_1/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose30 [Transpose] outputs: [conv2d_1/BiasAdd:0_transposed -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_1 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_1/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale7 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias7 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean7 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var7 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_1 [BatchNormalization] inputs: [conv2d_1/BiasAdd:0_transposed -> (-1, 192, 32, 32)[FLOAT]], [scale7 -> (192)[FLOAT]], [bias7 -> (192)[FLOAT]], [mean7 -> (192)[FLOAT]], [var7 -> (192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_1 for ONNX node: batch_normalization_1 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer7 for ONNX tensor: batch_norm_output_buffer7 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_1 [BatchNormalization] outputs: [batch_norm_output_buffer7 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose31 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer7 [11/01/2021-13:38:34] [V] [TRT] Transpose31 [Transpose] inputs: [batch_norm_output_buffer7 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose31 for ONNX node: Transpose31 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_1/cond/Identity:0 for ONNX tensor: batch_normalization_1/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose31 [Transpose] outputs: [batch_normalization_1/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity27 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_1/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity27 [Identity] inputs: [batch_normalization_1/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity27 for ONNX node: Identity27 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_1/activity_regularization_1/Identity:0 for ONNX tensor: activity_regularization_1/activity_regularization_1/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity27 [Identity] outputs: [activity_regularization_1/activity_regularization_1/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_1 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_1/activity_regularization_1/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_1 [Elu] inputs: [activity_regularization_1/activity_regularization_1/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_1 for ONNX node: elu_1 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_1/Elu:0 for ONNX tensor: elu_1/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_1 [Elu] outputs: [elu_1/Elu:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity26 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_1/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Identity26 [Identity] inputs: [elu_1/Elu:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity26 for ONNX node: Identity26 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: dropout/cond/Identity:0 for ONNX tensor: dropout/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity26 [Identity] outputs: [dropout/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose28 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: dropout/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose28 [Transpose] inputs: [dropout/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose28 for ONNX node: Transpose28 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input7 for ONNX tensor: adjusted_input7 [11/01/2021-13:38:34] [V] [TRT] Transpose28 [Transpose] outputs: [adjusted_input7 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_2 [Conv] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input7 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_2/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_2/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_2 [Conv] inputs: [adjusted_input7 -> (-1, 192, 32, 32)[FLOAT]], [conv2d_2/kernel:0 -> (256, 192, 3, 3)[FLOAT]], [conv2d_2/bias:0 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Convolution input dimensions: (-1, 192, 32, 32) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_2 for ONNX node: conv2d_2 [11/01/2021-13:38:34] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [11/01/2021-13:38:34] [V] [TRT] Convolution output dimensions: (-1, 256, 16, 16) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output7 for ONNX tensor: convolution_output7 [11/01/2021-13:38:34] [V] [TRT] conv2d_2 [Conv] outputs: [convolution_output7 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose29 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output7 [11/01/2021-13:38:34] [V] [TRT] Transpose29 [Transpose] inputs: [convolution_output7 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose29 for ONNX node: Transpose29 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output7 for ONNX tensor: transpose_output7 [11/01/2021-13:38:34] [V] [TRT] Transpose29 [Transpose] outputs: [transpose_output7 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity25 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output7 [11/01/2021-13:38:34] [V] [TRT] Identity25 [Identity] inputs: [transpose_output7 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity25 for ONNX node: Identity25 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_2/BiasAdd:0 for ONNX tensor: conv2d_2/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity25 [Identity] outputs: [conv2d_2/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose26 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_2/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose26 [Transpose] inputs: [conv2d_2/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose26 for ONNX node: Transpose26 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_2/BiasAdd:0_transposed for ONNX tensor: conv2d_2/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose26 [Transpose] outputs: [conv2d_2/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_2 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_2/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale6 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias6 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean6 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var6 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_2 [BatchNormalization] inputs: [conv2d_2/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [scale6 -> (256)[FLOAT]], [bias6 -> (256)[FLOAT]], [mean6 -> (256)[FLOAT]], [var6 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_2 for ONNX node: batch_normalization_2 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer6 for ONNX tensor: batch_norm_output_buffer6 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_2 [BatchNormalization] outputs: [batch_norm_output_buffer6 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose27 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer6 [11/01/2021-13:38:34] [V] [TRT] Transpose27 [Transpose] inputs: [batch_norm_output_buffer6 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose27 for ONNX node: Transpose27 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_2/cond/Identity:0 for ONNX tensor: batch_normalization_2/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose27 [Transpose] outputs: [batch_normalization_2/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity24 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_2/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity24 [Identity] inputs: [batch_normalization_2/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity24 for ONNX node: Identity24 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_2/activity_regularization_2/Identity:0 for ONNX tensor: activity_regularization_2/activity_regularization_2/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity24 [Identity] outputs: [activity_regularization_2/activity_regularization_2/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_2 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_2/activity_regularization_2/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_2 [Elu] inputs: [activity_regularization_2/activity_regularization_2/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_2 for ONNX node: elu_2 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_2/Elu:0 for ONNX tensor: elu_2/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_2 [Elu] outputs: [elu_2/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose24 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_2/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Transpose24 [Transpose] inputs: [elu_2/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose24 for ONNX node: Transpose24 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input6 for ONNX tensor: adjusted_input6 [11/01/2021-13:38:34] [V] [TRT] Transpose24 [Transpose] outputs: [adjusted_input6 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_3 [Conv] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input6 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_3/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_3/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_3 [Conv] inputs: [adjusted_input6 -> (-1, 256, 16, 16)[FLOAT]], [conv2d_3/kernel:0 -> (256, 256, 3, 3)[FLOAT]], [conv2d_3/bias:0 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Convolution input dimensions: (-1, 256, 16, 16) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_3 for ONNX node: conv2d_3 [11/01/2021-13:38:34] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [11/01/2021-13:38:34] [V] [TRT] Convolution output dimensions: (-1, 256, 16, 16) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output6 for ONNX tensor: convolution_output6 [11/01/2021-13:38:34] [V] [TRT] conv2d_3 [Conv] outputs: [convolution_output6 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose25 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output6 [11/01/2021-13:38:34] [V] [TRT] Transpose25 [Transpose] inputs: [convolution_output6 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose25 for ONNX node: Transpose25 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output6 for ONNX tensor: transpose_output6 [11/01/2021-13:38:34] [V] [TRT] Transpose25 [Transpose] outputs: [transpose_output6 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity23 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output6 [11/01/2021-13:38:34] [V] [TRT] Identity23 [Identity] inputs: [transpose_output6 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity23 for ONNX node: Identity23 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_3/BiasAdd:0 for ONNX tensor: conv2d_3/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity23 [Identity] outputs: [conv2d_3/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose22 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_3/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose22 [Transpose] inputs: [conv2d_3/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose22 for ONNX node: Transpose22 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_3/BiasAdd:0_transposed for ONNX tensor: conv2d_3/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose22 [Transpose] outputs: [conv2d_3/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_3 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_3/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale5 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias5 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean5 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var5 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_3 [BatchNormalization] inputs: [conv2d_3/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [scale5 -> (256)[FLOAT]], [bias5 -> (256)[FLOAT]], [mean5 -> (256)[FLOAT]], [var5 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_3 for ONNX node: batch_normalization_3 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer5 for ONNX tensor: batch_norm_output_buffer5 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_3 [BatchNormalization] outputs: [batch_norm_output_buffer5 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose23 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer5 [11/01/2021-13:38:34] [V] [TRT] Transpose23 [Transpose] inputs: [batch_norm_output_buffer5 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose23 for ONNX node: Transpose23 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_3/cond/Identity:0 for ONNX tensor: batch_normalization_3/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose23 [Transpose] outputs: [batch_normalization_3/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity22 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_3/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity22 [Identity] inputs: [batch_normalization_3/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity22 for ONNX node: Identity22 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_3/activity_regularization_3/Identity:0 for ONNX tensor: activity_regularization_3/activity_regularization_3/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity22 [Identity] outputs: [activity_regularization_3/activity_regularization_3/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_3 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_3/activity_regularization_3/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_3 [Elu] inputs: [activity_regularization_3/activity_regularization_3/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_3 for ONNX node: elu_3 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_3/Elu:0 for ONNX tensor: elu_3/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_3 [Elu] outputs: [elu_3/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose20 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_3/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Transpose20 [Transpose] inputs: [elu_3/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose20 for ONNX node: Transpose20 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input5 for ONNX tensor: adjusted_input5 [11/01/2021-13:38:34] [V] [TRT] Transpose20 [Transpose] outputs: [adjusted_input5 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_4 [Conv] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input5 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_4/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_4/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_4 [Conv] inputs: [adjusted_input5 -> (-1, 256, 16, 16)[FLOAT]], [conv2d_4/kernel:0 -> (384, 256, 3, 3)[FLOAT]], [conv2d_4/bias:0 -> (384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Convolution input dimensions: (-1, 256, 16, 16) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_4 for ONNX node: conv2d_4 [11/01/2021-13:38:34] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384 [11/01/2021-13:38:34] [V] [TRT] Convolution output dimensions: (-1, 384, 8, 8) [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output5 for ONNX tensor: convolution_output5 [11/01/2021-13:38:34] [V] [TRT] conv2d_4 [Conv] outputs: [convolution_output5 -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose21 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output5 [11/01/2021-13:38:34] [V] [TRT] Transpose21 [Transpose] inputs: [convolution_output5 -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose21 for ONNX node: Transpose21 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output5 for ONNX tensor: transpose_output5 [11/01/2021-13:38:34] [V] [TRT] Transpose21 [Transpose] outputs: [transpose_output5 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity21 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output5 [11/01/2021-13:38:34] [V] [TRT] Identity21 [Identity] inputs: [transpose_output5 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity21 for ONNX node: Identity21 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_4/BiasAdd:0 for ONNX tensor: conv2d_4/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity21 [Identity] outputs: [conv2d_4/BiasAdd:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose18 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_4/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose18 [Transpose] inputs: [conv2d_4/BiasAdd:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose18 for ONNX node: Transpose18 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_4/BiasAdd:0_transposed for ONNX tensor: conv2d_4/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose18 [Transpose] outputs: [conv2d_4/BiasAdd:0_transposed -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_4 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_4/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale4 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias4 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean4 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var4 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_4 [BatchNormalization] inputs: [conv2d_4/BiasAdd:0_transposed -> (-1, 384, 8, 8)[FLOAT]], [scale4 -> (384)[FLOAT]], [bias4 -> (384)[FLOAT]], [mean4 -> (384)[FLOAT]], [var4 -> (384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_4 for ONNX node: batch_normalization_4 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer4 for ONNX tensor: batch_norm_output_buffer4 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_4 [BatchNormalization] outputs: [batch_norm_output_buffer4 -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose19 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer4 [11/01/2021-13:38:34] [V] [TRT] Transpose19 [Transpose] inputs: [batch_norm_output_buffer4 -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose19 for ONNX node: Transpose19 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_4/cond/Identity:0 for ONNX tensor: batch_normalization_4/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose19 [Transpose] outputs: [batch_normalization_4/cond/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity20 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_4/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity20 [Identity] inputs: [batch_normalization_4/cond/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity20 for ONNX node: Identity20 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_4/activity_regularization_4/Identity:0 for ONNX tensor: activity_regularization_4/activity_regularization_4/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity20 [Identity] outputs: [activity_regularization_4/activity_regularization_4/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_4 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_4/activity_regularization_4/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_4 [Elu] inputs: [activity_regularization_4/activity_regularization_4/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_4 for ONNX node: elu_4 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_4/Elu:0 for ONNX tensor: elu_4/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_4 [Elu] outputs: [elu_4/Elu:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity19 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_4/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Identity19 [Identity] inputs: [elu_4/Elu:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity19 for ONNX node: Identity19 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: dropout_1/cond/Identity:0 for ONNX tensor: dropout_1/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity19 [Identity] outputs: [dropout_1/cond/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose16 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: dropout_1/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose16 [Transpose] inputs: [dropout_1/cond/Identity:0 -> (-1, 8, 8, 384)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose16 for ONNX node: Transpose16 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input4 for ONNX tensor: adjusted_input4 [11/01/2021-13:38:34] [V] [TRT] Transpose16 [Transpose] outputs: [adjusted_input4 -> (-1, 384, 8, 8)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_transpose [ConvTranspose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input4 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose [ConvTranspose] inputs: [adjusted_input4 -> (-1, 384, 8, 8)[FLOAT]], [conv2d_transpose/kernel:0 -> (384, 256, 3, 3)[FLOAT]], [conv2d_transpose/bias:0 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (1, 1) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_transpose for ONNX node: conv2d_transpose [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output4 for ONNX tensor: convolution_output4 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose [ConvTranspose] outputs: [convolution_output4 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose17 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output4 [11/01/2021-13:38:34] [V] [TRT] Transpose17 [Transpose] inputs: [convolution_output4 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose17 for ONNX node: Transpose17 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output4 for ONNX tensor: transpose_output4 [11/01/2021-13:38:34] [V] [TRT] Transpose17 [Transpose] outputs: [transpose_output4 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity18 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output4 [11/01/2021-13:38:34] [V] [TRT] Identity18 [Identity] inputs: [transpose_output4 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity18 for ONNX node: Identity18 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose/BiasAdd:0 for ONNX tensor: conv2d_transpose/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity18 [Identity] outputs: [conv2d_transpose/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose14 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose14 [Transpose] inputs: [conv2d_transpose/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose14 for ONNX node: Transpose14 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose/BiasAdd:0_transposed for ONNX tensor: conv2d_transpose/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose14 [Transpose] outputs: [conv2d_transpose/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_5 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale3 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias3 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean3 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var3 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_5 [BatchNormalization] inputs: [conv2d_transpose/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [scale3 -> (256)[FLOAT]], [bias3 -> (256)[FLOAT]], [mean3 -> (256)[FLOAT]], [var3 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_5 for ONNX node: batch_normalization_5 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer3 for ONNX tensor: batch_norm_output_buffer3 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_5 [BatchNormalization] outputs: [batch_norm_output_buffer3 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose15 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer3 [11/01/2021-13:38:34] [V] [TRT] Transpose15 [Transpose] inputs: [batch_norm_output_buffer3 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose15 for ONNX node: Transpose15 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_5/cond/Identity:0 for ONNX tensor: batch_normalization_5/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose15 [Transpose] outputs: [batch_normalization_5/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity17 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_5/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity17 [Identity] inputs: [batch_normalization_5/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity17 for ONNX node: Identity17 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_5/activity_regularization_5/Identity:0 for ONNX tensor: activity_regularization_5/activity_regularization_5/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity17 [Identity] outputs: [activity_regularization_5/activity_regularization_5/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_5 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_5/activity_regularization_5/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_5 [Elu] inputs: [activity_regularization_5/activity_regularization_5/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_5 for ONNX node: elu_5 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_5/Elu:0 for ONNX tensor: elu_5/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_5 [Elu] outputs: [elu_5/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity16 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_5/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Identity16 [Identity] inputs: [elu_5/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity16 for ONNX node: Identity16 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: dropout_2/cond/Identity:0 for ONNX tensor: dropout_2/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity16 [Identity] outputs: [dropout_2/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose12 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: dropout_2/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose12 [Transpose] inputs: [dropout_2/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose12 for ONNX node: Transpose12 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input3 for ONNX tensor: adjusted_input3 [11/01/2021-13:38:34] [V] [TRT] Transpose12 [Transpose] outputs: [adjusted_input3 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_transpose_1 [ConvTranspose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input3 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_1/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_1/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_1 [ConvTranspose] inputs: [adjusted_input3 -> (-1, 256, 16, 16)[FLOAT]], [conv2d_transpose_1/kernel:0 -> (256, 256, 3, 3)[FLOAT]], [conv2d_transpose_1/bias:0 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (1, 1) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_transpose_1 for ONNX node: conv2d_transpose_1 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output3 for ONNX tensor: convolution_output3 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_1 [ConvTranspose] outputs: [convolution_output3 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose13 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output3 [11/01/2021-13:38:34] [V] [TRT] Transpose13 [Transpose] inputs: [convolution_output3 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose13 for ONNX node: Transpose13 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output3 for ONNX tensor: transpose_output3 [11/01/2021-13:38:34] [V] [TRT] Transpose13 [Transpose] outputs: [transpose_output3 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity15 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output3 [11/01/2021-13:38:34] [V] [TRT] Identity15 [Identity] inputs: [transpose_output3 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity15 for ONNX node: Identity15 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_1/BiasAdd:0 for ONNX tensor: conv2d_transpose_1/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity15 [Identity] outputs: [conv2d_transpose_1/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose10 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_1/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose10 [Transpose] inputs: [conv2d_transpose_1/BiasAdd:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose10 for ONNX node: Transpose10 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_1/BiasAdd:0_transposed for ONNX tensor: conv2d_transpose_1/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose10 [Transpose] outputs: [conv2d_transpose_1/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_6 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_1/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale2 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias2 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean2 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var2 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_6 [BatchNormalization] inputs: [conv2d_transpose_1/BiasAdd:0_transposed -> (-1, 256, 16, 16)[FLOAT]], [scale2 -> (256)[FLOAT]], [bias2 -> (256)[FLOAT]], [mean2 -> (256)[FLOAT]], [var2 -> (256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_6 for ONNX node: batch_normalization_6 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer2 for ONNX tensor: batch_norm_output_buffer2 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_6 [BatchNormalization] outputs: [batch_norm_output_buffer2 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose11 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer2 [11/01/2021-13:38:34] [V] [TRT] Transpose11 [Transpose] inputs: [batch_norm_output_buffer2 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose11 for ONNX node: Transpose11 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_6/cond/Identity:0 for ONNX tensor: batch_normalization_6/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose11 [Transpose] outputs: [batch_normalization_6/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity14 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_6/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity14 [Identity] inputs: [batch_normalization_6/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity14 for ONNX node: Identity14 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_6/activity_regularization_6/Identity:0 for ONNX tensor: activity_regularization_6/activity_regularization_6/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity14 [Identity] outputs: [activity_regularization_6/activity_regularization_6/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_6 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_6/activity_regularization_6/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_6 [Elu] inputs: [activity_regularization_6/activity_regularization_6/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_6 for ONNX node: elu_6 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_6/Elu:0 for ONNX tensor: elu_6/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_6 [Elu] outputs: [elu_6/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity13 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_6/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Identity13 [Identity] inputs: [elu_6/Elu:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity13 for ONNX node: Identity13 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: dropout_3/cond/Identity:0 for ONNX tensor: dropout_3/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity13 [Identity] outputs: [dropout_3/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose8 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: dropout_3/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose8 [Transpose] inputs: [dropout_3/cond/Identity:0 -> (-1, 16, 16, 256)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose8 for ONNX node: Transpose8 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input2 for ONNX tensor: adjusted_input2 [11/01/2021-13:38:34] [V] [TRT] Transpose8 [Transpose] outputs: [adjusted_input2 -> (-1, 256, 16, 16)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_transpose_2 [ConvTranspose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input2 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_2/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_2/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_2 [ConvTranspose] inputs: [adjusted_input2 -> (-1, 256, 16, 16)[FLOAT]], [conv2d_transpose_2/kernel:0 -> (256, 192, 3, 3)[FLOAT]], [conv2d_transpose_2/bias:0 -> (192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (1, 1) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_transpose_2 for ONNX node: conv2d_transpose_2 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output2 for ONNX tensor: convolution_output2 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_2 [ConvTranspose] outputs: [convolution_output2 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose9 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output2 [11/01/2021-13:38:34] [V] [TRT] Transpose9 [Transpose] inputs: [convolution_output2 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose9 for ONNX node: Transpose9 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output2 for ONNX tensor: transpose_output2 [11/01/2021-13:38:34] [V] [TRT] Transpose9 [Transpose] outputs: [transpose_output2 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity12 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output2 [11/01/2021-13:38:34] [V] [TRT] Identity12 [Identity] inputs: [transpose_output2 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity12 for ONNX node: Identity12 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_2/BiasAdd:0 for ONNX tensor: conv2d_transpose_2/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity12 [Identity] outputs: [conv2d_transpose_2/BiasAdd:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose6 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_2/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose6 [Transpose] inputs: [conv2d_transpose_2/BiasAdd:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose6 for ONNX node: Transpose6 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_2/BiasAdd:0_transposed for ONNX tensor: conv2d_transpose_2/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose6 [Transpose] outputs: [conv2d_transpose_2/BiasAdd:0_transposed -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_7 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_2/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale1 [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias1 [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean1 [11/01/2021-13:38:34] [V] [TRT] Searching for input: var1 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_7 [BatchNormalization] inputs: [conv2d_transpose_2/BiasAdd:0_transposed -> (-1, 192, 32, 32)[FLOAT]], [scale1 -> (192)[FLOAT]], [bias1 -> (192)[FLOAT]], [mean1 -> (192)[FLOAT]], [var1 -> (192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_7 for ONNX node: batch_normalization_7 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer1 for ONNX tensor: batch_norm_output_buffer1 [11/01/2021-13:38:34] [V] [TRT] batch_normalization_7 [BatchNormalization] outputs: [batch_norm_output_buffer1 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose7 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer1 [11/01/2021-13:38:34] [V] [TRT] Transpose7 [Transpose] inputs: [batch_norm_output_buffer1 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose7 for ONNX node: Transpose7 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_7/cond/Identity:0 for ONNX tensor: batch_normalization_7/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose7 [Transpose] outputs: [batch_normalization_7/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity11 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_7/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity11 [Identity] inputs: [batch_normalization_7/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity11 for ONNX node: Identity11 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_7/activity_regularization_7/Identity:0 for ONNX tensor: activity_regularization_7/activity_regularization_7/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity11 [Identity] outputs: [activity_regularization_7/activity_regularization_7/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_7 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_7/activity_regularization_7/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_7 [Elu] inputs: [activity_regularization_7/activity_regularization_7/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_7 for ONNX node: elu_7 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_7/Elu:0 for ONNX tensor: elu_7/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_7 [Elu] outputs: [elu_7/Elu:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity10 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_7/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Identity10 [Identity] inputs: [elu_7/Elu:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity10 for ONNX node: Identity10 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: dropout_4/cond/Identity:0 for ONNX tensor: dropout_4/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity10 [Identity] outputs: [dropout_4/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose4 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: dropout_4/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose4 [Transpose] inputs: [dropout_4/cond/Identity:0 -> (-1, 32, 32, 192)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose4 for ONNX node: Transpose4 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input1 for ONNX tensor: adjusted_input1 [11/01/2021-13:38:34] [V] [TRT] Transpose4 [Transpose] outputs: [adjusted_input1 -> (-1, 192, 32, 32)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_transpose_3 [ConvTranspose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input1 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_3/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_3/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_3 [ConvTranspose] inputs: [adjusted_input1 -> (-1, 192, 32, 32)[FLOAT]], [conv2d_transpose_3/kernel:0 -> (192, 128, 5, 5)[FLOAT]], [conv2d_transpose_3/bias:0 -> (128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (2, 2) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_transpose_3 for ONNX node: conv2d_transpose_3 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output1 for ONNX tensor: convolution_output1 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_3 [ConvTranspose] outputs: [convolution_output1 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose5 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output1 [11/01/2021-13:38:34] [V] [TRT] Transpose5 [Transpose] inputs: [convolution_output1 -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose5 for ONNX node: Transpose5 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output1 for ONNX tensor: transpose_output1 [11/01/2021-13:38:34] [V] [TRT] Transpose5 [Transpose] outputs: [transpose_output1 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity9 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output1 [11/01/2021-13:38:34] [V] [TRT] Identity9 [Identity] inputs: [transpose_output1 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity9 for ONNX node: Identity9 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_3/BiasAdd:0 for ONNX tensor: conv2d_transpose_3/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity9 [Identity] outputs: [conv2d_transpose_3/BiasAdd:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose2 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_3/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Transpose2 [Transpose] inputs: [conv2d_transpose_3/BiasAdd:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose2 for ONNX node: Transpose2 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_3/BiasAdd:0_transposed for ONNX tensor: conv2d_transpose_3/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Transpose2 [Transpose] outputs: [conv2d_transpose_3/BiasAdd:0_transposed -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: batch_normalization_8 [BatchNormalization] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_3/BiasAdd:0_transposed [11/01/2021-13:38:34] [V] [TRT] Searching for input: scale [11/01/2021-13:38:34] [V] [TRT] Searching for input: bias [11/01/2021-13:38:34] [V] [TRT] Searching for input: mean [11/01/2021-13:38:34] [V] [TRT] Searching for input: var [11/01/2021-13:38:34] [V] [TRT] batch_normalization_8 [BatchNormalization] inputs: [conv2d_transpose_3/BiasAdd:0_transposed -> (-1, 128, 64, 64)[FLOAT]], [scale -> (128)[FLOAT]], [bias -> (128)[FLOAT]], [mean -> (128)[FLOAT]], [var -> (128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: batch_normalization_8 for ONNX node: batch_normalization_8 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_norm_output_buffer for ONNX tensor: batch_norm_output_buffer [11/01/2021-13:38:34] [V] [TRT] batch_normalization_8 [BatchNormalization] outputs: [batch_norm_output_buffer -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose3 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_norm_output_buffer [11/01/2021-13:38:34] [V] [TRT] Transpose3 [Transpose] inputs: [batch_norm_output_buffer -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose3 for ONNX node: Transpose3 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: batch_normalization_8/cond/Identity:0 for ONNX tensor: batch_normalization_8/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Transpose3 [Transpose] outputs: [batch_normalization_8/cond/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity8 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: batch_normalization_8/cond/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity8 [Identity] inputs: [batch_normalization_8/cond/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity8 for ONNX node: Identity8 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: activity_regularization_8/activity_regularization_8/Identity:0 for ONNX tensor: activity_regularization_8/activity_regularization_8/Identity:0 [11/01/2021-13:38:34] [V] [TRT] Identity8 [Identity] outputs: [activity_regularization_8/activity_regularization_8/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: elu_8 [Elu] [11/01/2021-13:38:34] [V] [TRT] Searching for input: activity_regularization_8/activity_regularization_8/Identity:0 [11/01/2021-13:38:34] [V] [TRT] elu_8 [Elu] inputs: [activity_regularization_8/activity_regularization_8/Identity:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: elu_8 for ONNX node: elu_8 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: elu_8/Elu:0 for ONNX tensor: elu_8/Elu:0 [11/01/2021-13:38:34] [V] [TRT] elu_8 [Elu] outputs: [elu_8/Elu:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: elu_8/Elu:0 [11/01/2021-13:38:34] [V] [TRT] Transpose [Transpose] inputs: [elu_8/Elu:0 -> (-1, 64, 64, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose for ONNX node: Transpose [11/01/2021-13:38:34] [V] [TRT] Registering tensor: adjusted_input for ONNX tensor: adjusted_input [11/01/2021-13:38:34] [V] [TRT] Transpose [Transpose] outputs: [adjusted_input -> (-1, 128, 64, 64)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: conv2d_transpose_4 [ConvTranspose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: adjusted_input [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_4/kernel:0 [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_4/bias:0 [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_4 [ConvTranspose] inputs: [adjusted_input -> (-1, 128, 64, 64)[FLOAT]], [conv2d_transpose_4/kernel:0 -> (128, 3, 5, 5)[FLOAT]], [conv2d_transpose_4/bias:0 -> (3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (1, 1) Post-padding: (2, 2) [11/01/2021-13:38:34] [V] [TRT] Registering layer: conv2d_transpose_4 for ONNX node: conv2d_transpose_4 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: convolution_output for ONNX tensor: convolution_output [11/01/2021-13:38:34] [V] [TRT] conv2d_transpose_4 [ConvTranspose] outputs: [convolution_output -> (-1, 3, 128, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Transpose1 [Transpose] [11/01/2021-13:38:34] [V] [TRT] Searching for input: convolution_output [11/01/2021-13:38:34] [V] [TRT] Transpose1 [Transpose] inputs: [convolution_output -> (-1, 3, 128, 128)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Transpose1 for ONNX node: Transpose1 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: transpose_output for ONNX tensor: transpose_output [11/01/2021-13:38:34] [V] [TRT] Transpose1 [Transpose] outputs: [transpose_output -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity7 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: transpose_output [11/01/2021-13:38:34] [V] [TRT] Identity7 [Identity] inputs: [transpose_output -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity7 for ONNX node: Identity7 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: conv2d_transpose_4/BiasAdd:0 for ONNX tensor: conv2d_transpose_4/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Identity7 [Identity] outputs: [conv2d_transpose_4/BiasAdd:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Sigmoid [Sigmoid] [11/01/2021-13:38:34] [V] [TRT] Searching for input: conv2d_transpose_4/BiasAdd:0 [11/01/2021-13:38:34] [V] [TRT] Sigmoid [Sigmoid] inputs: [conv2d_transpose_4/BiasAdd:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Sigmoid for ONNX node: Sigmoid [11/01/2021-13:38:34] [V] [TRT] Registering tensor: outputs/Sigmoid:01 for ONNX tensor: outputs/Sigmoid:01 [11/01/2021-13:38:34] [V] [TRT] Sigmoid [Sigmoid] outputs: [outputs/Sigmoid:01 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity6 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: outputs/Sigmoid:01 [11/01/2021-13:38:34] [V] [TRT] Identity6 [Identity] inputs: [outputs/Sigmoid:01 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity6 for ONNX node: Identity6 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: outputs/Sigmoid:0 for ONNX tensor: outputs/Sigmoid:0 [11/01/2021-13:38:34] [V] [TRT] Identity6 [Identity] outputs: [outputs/Sigmoid:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Parsing node: Identity5 [Identity] [11/01/2021-13:38:34] [V] [TRT] Searching for input: outputs/Sigmoid:0 [11/01/2021-13:38:34] [V] [TRT] Identity5 [Identity] inputs: [outputs/Sigmoid:0 -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Registering layer: Identity5 for ONNX node: Identity5 [11/01/2021-13:38:34] [V] [TRT] Registering tensor: outputs_0 for ONNX tensor: outputs [11/01/2021-13:38:34] [V] [TRT] Identity5 [Identity] outputs: [outputs -> (-1, 128, 128, 3)[FLOAT]], [11/01/2021-13:38:34] [V] [TRT] Marking outputs_0 as output: outputs [11/01/2021-13:38:34] [I] Finish parsing network model [11/01/2021-13:38:34] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 391, GPU 6059 (MiB) [11/01/2021-13:38:34] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 391 MiB, GPU 6059 MiB [11/01/2021-13:38:34] [V] [TRT] Applying generic optimizations to the graph for inference. [11/01/2021-13:38:34] [V] [TRT] Original: 95 layers [11/01/2021-13:38:34] [V] [TRT] After dead-layer removal: 95 layers [11/01/2021-13:38:34] [V] [TRT] After Myelin optimization: 95 layers [11/01/2021-13:38:34] [V] [TRT] After scale fusion: 95 layers [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_1 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_2 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_3 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_4 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_5 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_6 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_7 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of elu_8 from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] Swap the layer type of Sigmoid from ACTIVATION to POINTWISE [11/01/2021-13:38:34] [V] [TRT] After vertical fusions: 95 layers [11/01/2021-13:38:34] [V] [TRT] After dupe layer removal: 95 layers [11/01/2021-13:38:34] [V] [TRT] After final dead-layer removal: 95 layers [11/01/2021-13:38:34] [V] [TRT] After tensor merging: 95 layers [11/01/2021-13:38:34] [V] [TRT] After concat removal: 95 layers [11/01/2021-13:38:34] [V] [TRT] Graph construction and optimization completed in 0.0120582 seconds. [11/01/2021-13:38:34] [I] [TRT] ---------- Layers Running on DLA ---------- [11/01/2021-13:38:34] [I] [TRT] ---------- Layers Running on GPU ---------- [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity4 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity31 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose36 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose37 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity30 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose34 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose35 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity29 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose32 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_1 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose33 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity28 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose30 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_1 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose31 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity27 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_1) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity26 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose28 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_2 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose29 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity25 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose26 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_2 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose27 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity24 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_2) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose24 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_3 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose25 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity23 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose22 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_3 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose23 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity22 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_3) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose20 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_4 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose21 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity21 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose18 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_4 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose19 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity20 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_4) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity19 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose16 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_transpose [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose17 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity18 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose14 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_5 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose15 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity17 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_5) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity16 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose12 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_transpose_1 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose13 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity15 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose10 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_6 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose11 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity14 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_6) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity13 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose8 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_transpose_2 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose9 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity12 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose6 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_7 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose7 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity11 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_7) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity10 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose4 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_transpose_3 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose5 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity9 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose2 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] batch_normalization_8 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose3 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity8 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(elu_8) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] conv2d_transpose_4 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Transpose1 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity7 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] PWN(Sigmoid) [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity6 [11/01/2021-13:38:34] [I] [TRT] [GpuLayer] Identity5 [11/01/2021-13:38:35] [V] [TRT] Using cublas a tactic source [11/01/2021-13:38:35] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +227, GPU +188, now: CPU 618, GPU 6247 (MiB) [11/01/2021-13:38:35] [V] [TRT] Using cuDNN as a tactic source [11/01/2021-13:38:36] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +307, GPU +297, now: CPU 925, GPU 6544 (MiB) [11/01/2021-13:38:36] [11/01/2021-13:38:36] [V] [TRT] Constructing optimization profile number 0 [1/1]. [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 2.41089 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 3.43768 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 2.41089 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 1.01084 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 3.38981 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 1.01084 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.997236 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 0.578828 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 0 Time: 0.578828 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.617696 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 1.32057 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.617696 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.604416 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 3.35818 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.604416 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 1.10331 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 1.40881 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 1.10331 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.55112 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 0.70146 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.55112 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.613848 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 3.95811 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.613848 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 1.08234 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 1.42391 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 1.08234 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.595124 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 0.877524 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.595124 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Cast) [11/01/2021-13:38:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Identity4 (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.638492 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 0.594624 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 0 Time: 0.594624 [11/01/2021-13:38:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,1,384,128) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 1.10854 [11/01/2021-13:38:36] [V] [TRT] Tactic: 0 Time: 1.42069 [11/01/2021-13:38:36] [V] [TRT] Fastest Tactic: 1002 Time: 1.10854 [11/01/2021-13:38:36] [V] [TRT] *************** Autotuning Reformat:Float(49152,1,384,128) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:36] [V] [TRT] Tactic: 1002 Time: 0.614936 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 3.96869 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.614936 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(1536,384:32,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 1.086 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 1.42941 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 1.086 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(1536,384:32,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.605908 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.827592 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.605908 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.981532 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.594008 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 0 Time: 0.594008 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.614952 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 1.35856 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.614952 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.615228 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 3.30052 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.615228 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 1.10266 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 1.40937 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 1.10266 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.557184 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.702996 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.557184 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.628368 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 3.96546 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.628368 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 1.08149 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 1.42764 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 1.08149 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.603264 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.839864 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.603264 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Cast) [11/01/2021-13:38:37] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Identity31 (Reformat) [11/01/2021-13:38:37] [V] [TRT] Tactic: 1002 Time: 0.641048 [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.587932 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 0 Time: 0.587932 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(49152,384,3,1) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(49152,1,384,128) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(49152,1,384,128) -> Float(1536,384:32,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(1536,384:32,3,1) -> Float(49152,384,3,1) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning Reformat:Float(1536,384:32,3,1) -> Float(49152,1,384,128) *************** [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,384,3,1) -> Float(49152,16384,128,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Transpose36 (Shuffle) [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 0.820892 [11/01/2021-13:38:37] [V] [TRT] Tactic: 1 Time: 12.278 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 0 Time: 0.820892 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,128) -> Float(49152,1,384,3) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Transpose36 (Shuffle) [11/01/2021-13:38:37] [V] [TRT] Tactic: 0 Time: 3.53024 [11/01/2021-13:38:37] [V] [TRT] Tactic: 1 Time: 0.609276 [11/01/2021-13:38:37] [V] [TRT] Fastest Tactic: 1 Time: 0.609276 [11/01/2021-13:38:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:38:37] [V] [TRT] *************** Autotuning format combination: Float(1536,384:32,3,1) -> Float(16384,16384:32,128,1) *************** [11/01/2021-13:38:37] [V] [TRT] --------------- Timing Runner: Transpose36 (Shuffle) [11/01/2021-13:38:38] [V] [TRT] Tactic: 0 Time: 42.6699 [11/01/2021-13:38:38] [V] [TRT] Tactic: 1 Time: 13.3387 [11/01/2021-13:38:38] [V] [TRT] Fastest Tactic: 1 Time: 13.3387 [11/01/2021-13:38:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:38:38] [V] [TRT] *************** Autotuning Reformat:Float(49152,16384,128,1) -> Float(49152,1,384,3) *************** [11/01/2021-13:38:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:39] [V] [TRT] Tactic: 1002 Time: 14.3226 [11/01/2021-13:38:39] [V] [TRT] Tactic: 0 Time: 0.71482 [11/01/2021-13:38:39] [V] [TRT] Fastest Tactic: 0 Time: 0.71482 [11/01/2021-13:38:39] [V] [TRT] *************** Autotuning Reformat:Float(49152,1,384,3) -> Float(49152,16384,128,1) *************** [11/01/2021-13:38:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:39] [V] [TRT] Tactic: 1002 Time: 12.8309 [11/01/2021-13:38:39] [V] [TRT] Tactic: 0 Time: 0.813724 [11/01/2021-13:38:39] [V] [TRT] Fastest Tactic: 0 Time: 0.813724 [11/01/2021-13:38:39] [V] [TRT] *************** Autotuning Reformat:Float(16384,16384:32,128,1) -> Float(49152,16384,128,1) *************** [11/01/2021-13:38:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:39] [V] [TRT] Tactic: 1002 Time: 12.7515 [11/01/2021-13:38:39] [V] [TRT] Tactic: 0 Time: 3.38084 [11/01/2021-13:38:39] [V] [TRT] Fastest Tactic: 0 Time: 3.38084 [11/01/2021-13:38:39] [V] [TRT] *************** Autotuning Reformat:Float(16384,16384:32,128,1) -> Float(49152,1,384,3) *************** [11/01/2021-13:38:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:39] [V] [TRT] Tactic: 1002 Time: 8.12898 [11/01/2021-13:38:39] [V] [TRT] Tactic: 0 Time: 1.44043 [11/01/2021-13:38:39] [V] [TRT] Fastest Tactic: 0 Time: 1.44043 [11/01/2021-13:38:39] [V] [TRT] *************** Autotuning format combination: Float(49152,16384,128,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:38:39] [V] [TRT] --------------- Timing Runner: conv2d (CudaDepthwiseConvolution) [11/01/2021-13:38:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [11/01/2021-13:38:40] [V] [TRT] --------------- Timing Runner: conv2d (CudnnConvolution) [11/01/2021-13:38:41] [V] [TRT] Tactic: 0 Time: 25.5473 [11/01/2021-13:38:41] [V] [TRT] Tactic: 1 Time: 19.7127 [11/01/2021-13:38:42] [V] [TRT] Tactic: 2 Time: 27.9875 [11/01/2021-13:38:43] [V] [TRT] Tactic: 5 Time: 86.6867 [11/01/2021-13:38:44] [V] [TRT] Tactic: 56 Time: 25.6364 [11/01/2021-13:38:44] [V] [TRT] Tactic: 57 Time: 19.8006 [11/01/2021-13:38:45] [V] [TRT] Tactic: 58 Time: 28.5096 [11/01/2021-13:38:46] [V] [TRT] Tactic: 61 Time: 86.5487 [11/01/2021-13:38:46] [V] [TRT] Fastest Tactic: 1 Time: 19.7127 [11/01/2021-13:38:46] [V] [TRT] --------------- Timing Runner: conv2d (CaskConvolution) [11/01/2021-13:38:46] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384 [11/01/2021-13:38:46] [V] [TRT] Tactic: 1825138533642645384 Time: 11.695 [11/01/2021-13:38:46] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458 [11/01/2021-13:38:46] [V] [TRT] Tactic: 2842488832350522458 Time: 11.584 [11/01/2021-13:38:46] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238 [11/01/2021-13:38:47] [V] [TRT] Tactic: 3915320020053085238 Time: 12.1321 [11/01/2021-13:38:47] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203 [11/01/2021-13:38:47] [V] [TRT] Tactic: 6448355332020552203 Time: 16.3431 [11/01/2021-13:38:47] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604 [11/01/2021-13:38:47] [V] [TRT] Tactic: 6808617066150061604 Time: 11.1527 [11/01/2021-13:38:47] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864 [11/01/2021-13:38:47] [V] [TRT] Tactic: -8060443123034038864 Time: 11.3073 [11/01/2021-13:38:47] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522 [11/01/2021-13:38:48] [V] [TRT] Tactic: -4420849921117327522 Time: 13.5881 [11/01/2021-13:38:48] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337 [11/01/2021-13:38:48] [V] [TRT] Tactic: -3946921629105938337 Time: 11.9239 [11/01/2021-13:38:48] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 11.1527 [11/01/2021-13:38:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [11/01/2021-13:38:48] [V] [TRT] *************** Autotuning format combination: Float(49152,1,384,3) -> Float(524288,1,8192,128) *************** [11/01/2021-13:38:48] [V] [TRT] --------------- Timing Runner: conv2d (CudnnConvolution) [11/01/2021-13:38:48] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [11/01/2021-13:38:48] [V] [TRT] --------------- Timing Runner: conv2d (CaskConvolution) [11/01/2021-13:38:48] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [11/01/2021-13:38:48] [V] [TRT] Tactic: 861694390046228376 Time: 25.9791 [11/01/2021-13:38:48] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [11/01/2021-13:38:49] [V] [TRT] Tactic: 5821621277990374316 Time: 26.7898 [11/01/2021-13:38:49] [V] [TRT] conv2d Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [11/01/2021-13:38:49] [V] [TRT] Tactic: -3853827649136781465 Time: 26.2944 [11/01/2021-13:38:49] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 25.9791 [11/01/2021-13:38:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [11/01/2021-13:38:49] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:38:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:49] [V] [TRT] Tactic: 1002 Time: 6.96389 [11/01/2021-13:38:50] [V] [TRT] Tactic: 0 Time: 14.8633 [11/01/2021-13:38:50] [V] [TRT] Fastest Tactic: 1002 Time: 6.96389 [11/01/2021-13:38:50] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:38:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:50] [V] [TRT] Tactic: 1002 Time: 6.69768 [11/01/2021-13:38:50] [V] [TRT] Tactic: 0 Time: 38.237 [11/01/2021-13:38:50] [V] [TRT] Fastest Tactic: 1002 Time: 6.69768 [11/01/2021-13:38:50] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(524288,4096,64,1) *************** [11/01/2021-13:38:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:51] [V] [TRT] Tactic: 1002 Time: 11.3321 [11/01/2021-13:38:51] [V] [TRT] Tactic: 0 Time: 22.0541 [11/01/2021-13:38:51] [V] [TRT] Fastest Tactic: 1002 Time: 11.3321 [11/01/2021-13:38:51] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:38:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:51] [V] [TRT] Tactic: 1002 Time: 6.6139 [11/01/2021-13:38:52] [V] [TRT] Tactic: 0 Time: 60.948 [11/01/2021-13:38:52] [V] [TRT] Fastest Tactic: 1002 Time: 6.6139 [11/01/2021-13:38:52] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:38:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:52] [V] [TRT] Tactic: 1002 Time: 11.008 [11/01/2021-13:38:53] [V] [TRT] Tactic: 0 Time: 21.1597 [11/01/2021-13:38:53] [V] [TRT] Fastest Tactic: 1002 Time: 11.008 [11/01/2021-13:38:53] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:38:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:53] [V] [TRT] Tactic: 1002 Time: 6.49382 [11/01/2021-13:38:53] [V] [TRT] Tactic: 0 Time: 9.51035 [11/01/2021-13:38:53] [V] [TRT] Fastest Tactic: 1002 Time: 6.49382 [11/01/2021-13:38:53] [V] [TRT] *************** Autotuning format combination: Float(524288,4096,64,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:38:53] [V] [TRT] --------------- Timing Runner: Transpose37 (Shuffle) [11/01/2021-13:38:53] [V] [TRT] Tactic: 0 Time: 15.1032 [11/01/2021-13:38:54] [V] [TRT] Tactic: 1 Time: 6.53808 [11/01/2021-13:38:54] [V] [TRT] Fastest Tactic: 1 Time: 6.53808 [11/01/2021-13:38:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:38:54] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,128) -> Float(524288,1,8192,64) *************** [11/01/2021-13:38:54] [V] [TRT] --------------- Timing Runner: Transpose37 (Shuffle) [11/01/2021-13:38:55] [V] [TRT] Tactic: 0 Time: 61.8088 [11/01/2021-13:38:55] [V] [TRT] Tactic: 1 Time: 7.095 [11/01/2021-13:38:55] [V] [TRT] Fastest Tactic: 1 Time: 7.095 [11/01/2021-13:38:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:38:55] [V] [TRT] *************** Autotuning format combination: Float(16384,4096:32,64,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:38:55] [V] [TRT] --------------- Timing Runner: Transpose37 (Shuffle) [11/01/2021-13:38:55] [V] [TRT] Tactic: 0 Time: 41.373 [11/01/2021-13:38:56] [V] [TRT] Tactic: 1 Time: 6.58772 [11/01/2021-13:38:56] [V] [TRT] Fastest Tactic: 1 Time: 6.58772 [11/01/2021-13:38:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:38:56] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:38:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:56] [V] [TRT] Tactic: 1002 Time: 6.84906 [11/01/2021-13:38:56] [V] [TRT] Tactic: 0 Time: 18.3663 [11/01/2021-13:38:56] [V] [TRT] Fastest Tactic: 1002 Time: 6.84906 [11/01/2021-13:38:56] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:38:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:56] [V] [TRT] Tactic: 1002 Time: 6.96406 [11/01/2021-13:38:57] [V] [TRT] Tactic: 0 Time: 41.5082 [11/01/2021-13:38:57] [V] [TRT] Fastest Tactic: 1002 Time: 6.96406 [11/01/2021-13:38:57] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:38:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:57] [V] [TRT] Tactic: 1002 Time: 11.2069 [11/01/2021-13:38:58] [V] [TRT] Tactic: 0 Time: 35.8243 [11/01/2021-13:38:58] [V] [TRT] Fastest Tactic: 1002 Time: 11.2069 [11/01/2021-13:38:58] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:38:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:58] [V] [TRT] Tactic: 1002 Time: 7.17157 [11/01/2021-13:38:59] [V] [TRT] Tactic: 0 Time: 72.0641 [11/01/2021-13:38:59] [V] [TRT] Fastest Tactic: 1002 Time: 7.17157 [11/01/2021-13:38:59] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:38:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:38:59] [V] [TRT] Tactic: 1002 Time: 11.3719 [11/01/2021-13:39:00] [V] [TRT] Tactic: 0 Time: 34.5803 [11/01/2021-13:39:00] [V] [TRT] Fastest Tactic: 1002 Time: 11.3719 [11/01/2021-13:39:00] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:39:00] [V] [TRT] Tactic: 1002 Time: 7.0339 [11/01/2021-13:39:00] [V] [TRT] Tactic: 0 Time: 9.94364 [11/01/2021-13:39:00] [V] [TRT] Fastest Tactic: 1002 Time: 7.0339 [11/01/2021-13:39:00] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:00] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:00] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:00] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:00] [V] [TRT] Tactic: 1002 Time: 10.6877 [11/01/2021-13:39:01] [V] [TRT] Tactic: 0 Time: 7.06906 [11/01/2021-13:39:01] [V] [TRT] Fastest Tactic: 0 Time: 7.06906 [11/01/2021-13:39:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:39:01] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:01] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:01] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:01] [V] [TRT] Tactic: 1002 Time: 6.85521 [11/01/2021-13:39:01] [V] [TRT] Tactic: 0 Time: 18.7779 [11/01/2021-13:39:01] [V] [TRT] Fastest Tactic: 1002 Time: 6.85521 [11/01/2021-13:39:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:01] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:01] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:01] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:01] [V] [TRT] Tactic: 1002 Time: 6.71349 [11/01/2021-13:39:02] [V] [TRT] Tactic: 0 Time: 41.6376 [11/01/2021-13:39:02] [V] [TRT] Fastest Tactic: 1002 Time: 6.71349 [11/01/2021-13:39:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:02] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:02] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:02] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:02] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:02] [V] [TRT] Tactic: 1002 Time: 11.4171 [11/01/2021-13:39:03] [V] [TRT] Tactic: 0 Time: 35.9342 [11/01/2021-13:39:03] [V] [TRT] Fastest Tactic: 1002 Time: 11.4171 [11/01/2021-13:39:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:03] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:03] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:03] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:03] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:03] [V] [TRT] Tactic: 1002 Time: 6.51706 [11/01/2021-13:39:03] [V] [TRT] Tactic: 0 Time: 9.1697 [11/01/2021-13:39:03] [V] [TRT] Fastest Tactic: 1002 Time: 6.51706 [11/01/2021-13:39:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:03] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:03] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:03] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:03] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:03] [V] [TRT] Tactic: 1002 Time: 6.72632 [11/01/2021-13:39:04] [V] [TRT] Tactic: 0 Time: 71.344 [11/01/2021-13:39:04] [V] [TRT] Fastest Tactic: 1002 Time: 6.72632 [11/01/2021-13:39:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:04] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:04] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:04] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:04] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:05] [V] [TRT] Tactic: 1002 Time: 11.1917 [11/01/2021-13:39:05] [V] [TRT] Tactic: 0 Time: 34.2293 [11/01/2021-13:39:05] [V] [TRT] Fastest Tactic: 1002 Time: 11.1917 [11/01/2021-13:39:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:05] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:05] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:05] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:05] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:05] [V] [TRT] Tactic: 1002 Time: 6.57094 [11/01/2021-13:39:06] [V] [TRT] Tactic: 0 Time: 9.54648 [11/01/2021-13:39:06] [V] [TRT] Fastest Tactic: 1002 Time: 6.57094 [11/01/2021-13:39:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:06] [V] [TRT] --------------- Timing Runner: Identity30 (Cast) [11/01/2021-13:39:06] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:06] [V] [TRT] --------------- Timing Runner: Identity30 (Reformat) [11/01/2021-13:39:06] [V] [TRT] Tactic: 1002 Time: 6.86214 [11/01/2021-13:39:06] [V] [TRT] Tactic: 0 Time: 7.37293 [11/01/2021-13:39:06] [V] [TRT] Fastest Tactic: 1002 Time: 6.86214 [11/01/2021-13:39:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:06] [V] [TRT] --------------- Timing Runner: Transpose34 (Shuffle) [11/01/2021-13:39:06] [V] [TRT] Tactic: 0 Time: 21.8739 [11/01/2021-13:39:06] [V] [TRT] Tactic: 1 Time: 6.63724 [11/01/2021-13:39:06] [V] [TRT] Fastest Tactic: 1 Time: 6.63724 [11/01/2021-13:39:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:06] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:06] [V] [TRT] --------------- Timing Runner: Transpose34 (Shuffle) [11/01/2021-13:39:07] [V] [TRT] Tactic: 0 Time: 55.8241 [11/01/2021-13:39:07] [V] [TRT] Tactic: 1 Time: 7.07018 [11/01/2021-13:39:07] [V] [TRT] Fastest Tactic: 1 Time: 7.07018 [11/01/2021-13:39:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:07] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:39:07] [V] [TRT] --------------- Timing Runner: Transpose34 (Shuffle) [11/01/2021-13:39:08] [V] [TRT] Tactic: 0 Time: 47.0945 [11/01/2021-13:39:08] [V] [TRT] Tactic: 1 Time: 6.48879 [11/01/2021-13:39:08] [V] [TRT] Fastest Tactic: 1 Time: 6.48879 [11/01/2021-13:39:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:08] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:08] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:08] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:08] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:08] [V] [TRT] *************** Autotuning format combination: Float(524288,4096,64,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:08] [V] [TRT] --------------- Timing Runner: batch_normalization (Scale) [11/01/2021-13:39:08] [V] [TRT] Tactic: 0 Time: 6.39064 [11/01/2021-13:39:09] [V] [TRT] Fastest Tactic: 0 Time: 6.39064 [11/01/2021-13:39:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,128) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:09] [V] [TRT] --------------- Timing Runner: batch_normalization (Scale) [11/01/2021-13:39:09] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning format combination: Float(524288,4096,64,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:09] [V] [TRT] --------------- Timing Runner: Transpose35 (Shuffle) [11/01/2021-13:39:09] [V] [TRT] Tactic: 0 Time: 15.3702 [11/01/2021-13:39:09] [V] [TRT] Tactic: 1 Time: 6.59432 [11/01/2021-13:39:09] [V] [TRT] Fastest Tactic: 1 Time: 6.59432 [11/01/2021-13:39:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:09] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,128) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:09] [V] [TRT] --------------- Timing Runner: Transpose35 (Shuffle) [11/01/2021-13:39:10] [V] [TRT] Tactic: 0 Time: 62.2886 [11/01/2021-13:39:10] [V] [TRT] Tactic: 1 Time: 6.73328 [11/01/2021-13:39:10] [V] [TRT] Fastest Tactic: 1 Time: 6.73328 [11/01/2021-13:39:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:10] [V] [TRT] *************** Autotuning format combination: Float(16384,4096:32,64,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:10] [V] [TRT] --------------- Timing Runner: Transpose35 (Shuffle) [11/01/2021-13:39:11] [V] [TRT] Tactic: 0 Time: 41.9314 [11/01/2021-13:39:11] [V] [TRT] Tactic: 1 Time: 6.98867 [11/01/2021-13:39:11] [V] [TRT] Fastest Tactic: 1 Time: 6.98867 [11/01/2021-13:39:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:11] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:11] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:11] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:11] [V] [TRT] Tactic: 1002 Time: 10.9621 [11/01/2021-13:39:11] [V] [TRT] Tactic: 0 Time: 7.00808 [11/01/2021-13:39:11] [V] [TRT] Fastest Tactic: 0 Time: 7.00808 [11/01/2021-13:39:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:39:11] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:11] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:11] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:11] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:11] [V] [TRT] Tactic: 1002 Time: 6.85574 [11/01/2021-13:39:12] [V] [TRT] Tactic: 0 Time: 18.3179 [11/01/2021-13:39:12] [V] [TRT] Fastest Tactic: 1002 Time: 6.85574 [11/01/2021-13:39:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:12] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:12] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:12] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:12] [V] [TRT] Tactic: 1002 Time: 6.94578 [11/01/2021-13:39:13] [V] [TRT] Tactic: 0 Time: 41.5488 [11/01/2021-13:39:13] [V] [TRT] Fastest Tactic: 1002 Time: 6.94578 [11/01/2021-13:39:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:13] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:13] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:13] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:13] [V] [TRT] Tactic: 1002 Time: 11.7929 [11/01/2021-13:39:14] [V] [TRT] Tactic: 0 Time: 35.556 [11/01/2021-13:39:14] [V] [TRT] Fastest Tactic: 1002 Time: 11.7929 [11/01/2021-13:39:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:14] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:14] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:14] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:14] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:14] [V] [TRT] Tactic: 1002 Time: 6.5434 [11/01/2021-13:39:14] [V] [TRT] Tactic: 0 Time: 9.53702 [11/01/2021-13:39:14] [V] [TRT] Fastest Tactic: 1002 Time: 6.5434 [11/01/2021-13:39:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:14] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:14] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:14] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:14] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:14] [V] [TRT] Tactic: 1002 Time: 6.94202 [11/01/2021-13:39:15] [V] [TRT] Tactic: 0 Time: 72.229 [11/01/2021-13:39:15] [V] [TRT] Fastest Tactic: 1002 Time: 6.94202 [11/01/2021-13:39:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:15] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:15] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:15] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:15] [V] [TRT] Tactic: 1002 Time: 11.21 [11/01/2021-13:39:16] [V] [TRT] Tactic: 0 Time: 34.2751 [11/01/2021-13:39:16] [V] [TRT] Fastest Tactic: 1002 Time: 11.21 [11/01/2021-13:39:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:16] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:16] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:16] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:16] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:16] [V] [TRT] Tactic: 1002 Time: 6.5097 [11/01/2021-13:39:16] [V] [TRT] Tactic: 0 Time: 9.351 [11/01/2021-13:39:16] [V] [TRT] Fastest Tactic: 1002 Time: 6.5097 [11/01/2021-13:39:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:16] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:16] [V] [TRT] --------------- Timing Runner: Identity29 (Cast) [11/01/2021-13:39:16] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:39:16] [V] [TRT] --------------- Timing Runner: Identity29 (Reformat) [11/01/2021-13:39:17] [V] [TRT] Tactic: 1002 Time: 6.89631 [11/01/2021-13:39:17] [V] [TRT] Tactic: 0 Time: 7.18061 [11/01/2021-13:39:17] [V] [TRT] Fastest Tactic: 1002 Time: 6.89631 [11/01/2021-13:39:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:17] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:17] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWiseV2) [11/01/2021-13:39:17] [V] [TRT] Tactic: 0 Time: 9.37144 [11/01/2021-13:39:18] [V] [TRT] Tactic: 1 Time: 7.48841 [11/01/2021-13:39:19] [V] [TRT] Tactic: 2 Time: 6.40103 [11/01/2021-13:39:20] [V] [TRT] Tactic: 3 Time: 7.06358 [11/01/2021-13:39:20] [V] [TRT] Tactic: 4 Time: 5.95345 [11/01/2021-13:39:21] [V] [TRT] Tactic: 5 Time: 6.31866 [11/01/2021-13:39:22] [V] [TRT] Tactic: 6 Time: 6.609 [11/01/2021-13:39:22] [V] [TRT] Tactic: 7 Time: 5.79821 [11/01/2021-13:39:23] [V] [TRT] Tactic: 8 Time: 5.69045 [11/01/2021-13:39:24] [V] [TRT] Tactic: 9 Time: 5.89236 [11/01/2021-13:39:24] [V] [TRT] Tactic: 28 Time: 9.31394 [11/01/2021-13:39:24] [V] [TRT] Fastest Tactic: 8 Time: 5.69045 [11/01/2021-13:39:24] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWise) [11/01/2021-13:39:25] [V] [TRT] Tactic: 128 Time: 34.4338 [11/01/2021-13:39:26] [V] [TRT] Tactic: 256 Time: 34.8495 [11/01/2021-13:39:26] [V] [TRT] Tactic: 512 Time: 34.8685 [11/01/2021-13:39:26] [V] [TRT] Fastest Tactic: 128 Time: 34.4338 [11/01/2021-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [11/01/2021-13:39:26] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:26] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWiseV2) [11/01/2021-13:39:26] [V] [TRT] Tactic: 0 Time: 9.4595 [11/01/2021-13:39:27] [V] [TRT] Tactic: 1 Time: 7.72168 [11/01/2021-13:39:27] [V] [TRT] Tactic: 2 Time: 6.55494 [11/01/2021-13:39:27] [V] [TRT] Tactic: 3 Time: 7.22532 [11/01/2021-13:39:27] [V] [TRT] Tactic: 4 Time: 6.16672 [11/01/2021-13:39:27] [V] [TRT] Tactic: 5 Time: 6.48839 [11/01/2021-13:39:27] [V] [TRT] Tactic: 6 Time: 6.98619 [11/01/2021-13:39:27] [V] [TRT] Tactic: 7 Time: 5.9517 [11/01/2021-13:39:28] [V] [TRT] Tactic: 8 Time: 5.87028 [11/01/2021-13:39:28] [V] [TRT] Tactic: 9 Time: 5.98257 [11/01/2021-13:39:28] [V] [TRT] Tactic: 28 Time: 9.33079 [11/01/2021-13:39:28] [V] [TRT] Fastest Tactic: 8 Time: 5.87028 [11/01/2021-13:39:28] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWise) [11/01/2021-13:39:29] [V] [TRT] Tactic: 128 Time: 35.16 [11/01/2021-13:39:29] [V] [TRT] Tactic: 256 Time: 35.0872 [11/01/2021-13:39:30] [V] [TRT] Tactic: 512 Time: 34.987 [11/01/2021-13:39:30] [V] [TRT] Fastest Tactic: 512 Time: 34.987 [11/01/2021-13:39:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [11/01/2021-13:39:30] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:30] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWiseV2) [11/01/2021-13:39:31] [V] [TRT] Tactic: 24 Time: 9.146 [11/01/2021-13:39:31] [V] [TRT] Tactic: 25 Time: 9.17524 [11/01/2021-13:39:32] [V] [TRT] Tactic: 26 Time: 9.06004 [11/01/2021-13:39:33] [V] [TRT] Tactic: 27 Time: 9.25418 [11/01/2021-13:39:34] [V] [TRT] Tactic: 31 Time: 9.097 [11/01/2021-13:39:34] [V] [TRT] Fastest Tactic: 26 Time: 9.06004 [11/01/2021-13:39:34] [V] [TRT] --------------- Timing Runner: PWN(elu) (PointWise) [11/01/2021-13:39:34] [V] [TRT] Tactic: 128 Time: 35.104 [11/01/2021-13:39:35] [V] [TRT] Tactic: 256 Time: 34.6664 [11/01/2021-13:39:35] [V] [TRT] Tactic: 512 Time: 35.1381 [11/01/2021-13:39:35] [V] [TRT] Fastest Tactic: 256 Time: 34.6664 [11/01/2021-13:39:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(524288,8192,128,1) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,64) -> Float(16384,8192:32,128,1) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,8192,128,1) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning Reformat:Float(16384,8192:32,128,1) -> Float(524288,1,8192,64) *************** [11/01/2021-13:39:35] [V] [TRT] *************** Autotuning format combination: Float(524288,8192,128,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:35] [V] [TRT] --------------- Timing Runner: Transpose32 (Shuffle) [11/01/2021-13:39:36] [V] [TRT] Tactic: 0 Time: 22.2595 [11/01/2021-13:39:36] [V] [TRT] Tactic: 1 Time: 6.71614 [11/01/2021-13:39:36] [V] [TRT] Fastest Tactic: 1 Time: 6.71614 [11/01/2021-13:39:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:36] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,64) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:36] [V] [TRT] --------------- Timing Runner: Transpose32 (Shuffle) [11/01/2021-13:39:37] [V] [TRT] Tactic: 0 Time: 56.2211 [11/01/2021-13:39:37] [V] [TRT] Tactic: 1 Time: 6.80737 [11/01/2021-13:39:37] [V] [TRT] Fastest Tactic: 1 Time: 6.80737 [11/01/2021-13:39:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:37] [V] [TRT] *************** Autotuning format combination: Float(16384,8192:32,128,1) -> Float(16384,4096:32,64,1) *************** [11/01/2021-13:39:37] [V] [TRT] --------------- Timing Runner: Transpose32 (Shuffle) [11/01/2021-13:39:38] [V] [TRT] Tactic: 0 Time: 47.211 [11/01/2021-13:39:38] [V] [TRT] Tactic: 1 Time: 6.53187 [11/01/2021-13:39:38] [V] [TRT] Fastest Tactic: 1 Time: 6.53187 [11/01/2021-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:39:38] [V] [TRT] *************** Autotuning Reformat:Float(524288,4096,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:38] [V] [TRT] *************** Autotuning Reformat:Float(524288,1,8192,128) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:38] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:39:38] [V] [TRT] *************** Autotuning Reformat:Float(16384,4096:32,64,1) -> Float(524288,1,8192,128) *************** [11/01/2021-13:39:38] [V] [TRT] *************** Autotuning format combination: Float(524288,4096,64,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:39:38] [V] [TRT] --------------- Timing Runner: conv2d_1 (CudaDepthwiseConvolution) [11/01/2021-13:39:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [11/01/2021-13:39:38] [V] [TRT] --------------- Timing Runner: conv2d_1 (CudnnConvolution) [11/01/2021-13:39:42] [V] [TRT] Tactic: 0 Time: 264.502 [11/01/2021-13:39:45] [V] [TRT] Tactic: 1 Time: 169.729 [11/01/2021-13:39:45] [11/01/2021-13:39:45] [11/01/2021-13:39:48] [V] [TRT] Tactic: 5 Time: 150.509 [11/01/2021-13:39:52] [V] [TRT] Tactic: 56 Time: 266.198 [11/01/2021-13:39:55] [V] [TRT] Tactic: 57 Time: 168.929 [11/01/2021-13:39:55] [11/01/2021-13:39:55] [11/01/2021-13:39:57] [V] [TRT] Tactic: 61 Time: 150.071 [11/01/2021-13:39:57] [V] [TRT] Fastest Tactic: 61 Time: 150.071 [11/01/2021-13:39:57] [V] [TRT] --------------- Timing Runner: conv2d_1 (CaskConvolution) [11/01/2021-13:39:57] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384 [11/01/2021-13:40:00] [V] [TRT] Tactic: 1825138533642645384 Time: 202.776 [11/01/2021-13:40:00] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458 [11/01/2021-13:40:03] [V] [TRT] Tactic: 2842488832350522458 Time: 154.363 [11/01/2021-13:40:03] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238 [11/01/2021-13:40:06] [V] [TRT] Tactic: 3915320020053085238 Time: 201.366 [11/01/2021-13:40:06] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203 [11/01/2021-13:40:10] [V] [TRT] Tactic: 6448355332020552203 Time: 216.111 [11/01/2021-13:40:10] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604 [11/01/2021-13:40:12] [V] [TRT] Tactic: 6808617066150061604 Time: 156.571 [11/01/2021-13:40:12] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864 [11/01/2021-13:40:15] [V] [TRT] Tactic: -8060443123034038864 Time: 158.265 [11/01/2021-13:40:15] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522 [11/01/2021-13:40:18] [V] [TRT] Tactic: -4420849921117327522 Time: 173.054 [11/01/2021-13:40:18] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337 [11/01/2021-13:40:20] [V] [TRT] Tactic: -3946921629105938337 Time: 169.951 [11/01/2021-13:40:20] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 154.363 [11/01/2021-13:40:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 61 [11/01/2021-13:40:20] [V] [TRT] *************** Autotuning format combination: Float(524288,1,8192,128) -> Float(196608,1,6144,192) *************** [11/01/2021-13:40:20] [V] [TRT] --------------- Timing Runner: conv2d_1 (CudnnConvolution) [11/01/2021-13:40:20] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [11/01/2021-13:40:20] [V] [TRT] --------------- Timing Runner: conv2d_1 (CaskConvolution) [11/01/2021-13:40:20] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [11/01/2021-13:40:24] [V] [TRT] Tactic: 861694390046228376 Time: 203.918 [11/01/2021-13:40:24] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567 [11/01/2021-13:40:27] [V] [TRT] Tactic: 1017870653102653567 Time: 202.17 [11/01/2021-13:40:27] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167 [11/01/2021-13:40:29] [V] [TRT] Tactic: 5258189349241541167 Time: 155.701 [11/01/2021-13:40:29] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [11/01/2021-13:40:33] [V] [TRT] Tactic: 5821621277990374316 Time: 204.598 [11/01/2021-13:40:33] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648 [11/01/2021-13:40:35] [V] [TRT] Tactic: 5863767799113001648 Time: 158.138 [11/01/2021-13:40:35] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536 [11/01/2021-13:40:39] [V] [TRT] Tactic: -9147980667639709536 Time: 201.702 [11/01/2021-13:40:39] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857 [11/01/2021-13:40:41] [V] [TRT] Tactic: -8850904373104590857 Time: 156.098 [11/01/2021-13:40:41] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660 [11/01/2021-13:40:44] [V] [TRT] Tactic: -7751035352149795660 Time: 201.557 [11/01/2021-13:40:44] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [11/01/2021-13:40:48] [V] [TRT] Tactic: -3853827649136781465 Time: 204.076 [11/01/2021-13:40:48] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196 [11/01/2021-13:40:50] [V] [TRT] Tactic: -3263369460438823196 Time: 154.114 [11/01/2021-13:40:50] [V] [TRT] conv2d_1 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819 [11/01/2021-13:40:53] [V] [TRT] Tactic: -423878181466897819 Time: 158.755 [11/01/2021-13:40:53] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 154.114 [11/01/2021-13:40:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [11/01/2021-13:40:53] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:40:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:53] [V] [TRT] Tactic: 1002 Time: 2.60435 [11/01/2021-13:40:53] [V] [TRT] Tactic: 0 Time: 5.74142 [11/01/2021-13:40:53] [V] [TRT] Fastest Tactic: 1002 Time: 2.60435 [11/01/2021-13:40:53] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:40:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:53] [V] [TRT] Tactic: 1002 Time: 2.64753 [11/01/2021-13:40:53] [V] [TRT] Tactic: 0 Time: 14.0988 [11/01/2021-13:40:53] [V] [TRT] Fastest Tactic: 1002 Time: 2.64753 [11/01/2021-13:40:53] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:40:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:53] [V] [TRT] Tactic: 1002 Time: 4.23017 [11/01/2021-13:40:54] [V] [TRT] Tactic: 0 Time: 6.74976 [11/01/2021-13:40:54] [V] [TRT] Fastest Tactic: 1002 Time: 4.23017 [11/01/2021-13:40:54] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:40:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:54] [V] [TRT] Tactic: 1002 Time: 2.6047 [11/01/2021-13:40:54] [V] [TRT] Tactic: 0 Time: 17.3543 [11/01/2021-13:40:54] [V] [TRT] Fastest Tactic: 1002 Time: 2.6047 [11/01/2021-13:40:54] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:40:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:54] [V] [TRT] Tactic: 1002 Time: 4.38225 [11/01/2021-13:40:54] [V] [TRT] Tactic: 0 Time: 6.13689 [11/01/2021-13:40:54] [V] [TRT] Fastest Tactic: 1002 Time: 4.38225 [11/01/2021-13:40:54] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:40:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:54] [V] [TRT] Tactic: 1002 Time: 2.41612 [11/01/2021-13:40:54] [V] [TRT] Tactic: 0 Time: 3.73596 [11/01/2021-13:40:54] [V] [TRT] Fastest Tactic: 1002 Time: 2.41612 [11/01/2021-13:40:54] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:54] [V] [TRT] --------------- Timing Runner: Transpose33 (Shuffle) [11/01/2021-13:40:54] [V] [TRT] Tactic: 0 Time: 5.54137 [11/01/2021-13:40:54] [V] [TRT] Tactic: 1 Time: 2.44034 [11/01/2021-13:40:54] [V] [TRT] Fastest Tactic: 1 Time: 2.44034 [11/01/2021-13:40:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:40:54] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:54] [V] [TRT] --------------- Timing Runner: Transpose33 (Shuffle) [11/01/2021-13:40:55] [V] [TRT] Tactic: 0 Time: 19.1251 [11/01/2021-13:40:55] [V] [TRT] Tactic: 1 Time: 4.46638 [11/01/2021-13:40:55] [V] [TRT] Fastest Tactic: 1 Time: 4.46638 [11/01/2021-13:40:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:40:55] [V] [TRT] *************** Autotuning format combination: Float(6144,1024:32,32,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:55] [V] [TRT] --------------- Timing Runner: Transpose33 (Shuffle) [11/01/2021-13:40:55] [V] [TRT] Tactic: 0 Time: 14.4973 [11/01/2021-13:40:55] [V] [TRT] Tactic: 1 Time: 4.74984 [11/01/2021-13:40:55] [V] [TRT] Fastest Tactic: 1 Time: 4.74984 [11/01/2021-13:40:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:40:55] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:55] [V] [TRT] Tactic: 1002 Time: 4.9788 [11/01/2021-13:40:55] [V] [TRT] Tactic: 0 Time: 4.04091 [11/01/2021-13:40:55] [V] [TRT] Fastest Tactic: 0 Time: 4.04091 [11/01/2021-13:40:55] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:55] [V] [TRT] Tactic: 1002 Time: 5.22158 [11/01/2021-13:40:56] [V] [TRT] Tactic: 0 Time: 14.0224 [11/01/2021-13:40:56] [V] [TRT] Fastest Tactic: 1002 Time: 5.22158 [11/01/2021-13:40:56] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:56] [V] [TRT] Tactic: 1002 Time: 5.66987 [11/01/2021-13:40:56] [V] [TRT] Tactic: 0 Time: 11.1984 [11/01/2021-13:40:56] [V] [TRT] Fastest Tactic: 1002 Time: 5.66987 [11/01/2021-13:40:56] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:56] [V] [TRT] Tactic: 1002 Time: 2.4801 [11/01/2021-13:40:57] [V] [TRT] Tactic: 0 Time: 25.8233 [11/01/2021-13:40:57] [V] [TRT] Fastest Tactic: 1002 Time: 2.4801 [11/01/2021-13:40:57] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:57] [V] [TRT] Tactic: 1002 Time: 5.32454 [11/01/2021-13:40:57] [V] [TRT] Tactic: 0 Time: 11.2759 [11/01/2021-13:40:57] [V] [TRT] Fastest Tactic: 1002 Time: 5.32454 [11/01/2021-13:40:57] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:40:57] [V] [TRT] Tactic: 1002 Time: 2.61032 [11/01/2021-13:40:57] [V] [TRT] Tactic: 0 Time: 3.68372 [11/01/2021-13:40:57] [V] [TRT] Fastest Tactic: 1002 Time: 2.61032 [11/01/2021-13:40:57] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:57] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:57] [V] [TRT] Tactic: 1002 Time: 3.95599 [11/01/2021-13:40:57] [V] [TRT] Tactic: 0 Time: 2.62696 [11/01/2021-13:40:57] [V] [TRT] Fastest Tactic: 0 Time: 2.62696 [11/01/2021-13:40:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:40:57] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:57] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:57] [V] [TRT] Tactic: 1002 Time: 5.04926 [11/01/2021-13:40:57] [V] [TRT] Tactic: 0 Time: 4.162 [11/01/2021-13:40:57] [V] [TRT] Fastest Tactic: 0 Time: 4.162 [11/01/2021-13:40:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:40:57] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:57] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:57] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:57] [V] [TRT] Tactic: 1002 Time: 4.97636 [11/01/2021-13:40:58] [V] [TRT] Tactic: 0 Time: 14.5991 [11/01/2021-13:40:58] [V] [TRT] Fastest Tactic: 1002 Time: 4.97636 [11/01/2021-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:58] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:58] [V] [TRT] Tactic: 1002 Time: 5.4189 [11/01/2021-13:40:58] [V] [TRT] Tactic: 0 Time: 11.2915 [11/01/2021-13:40:58] [V] [TRT] Fastest Tactic: 1002 Time: 5.4189 [11/01/2021-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:58] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:58] [V] [TRT] Tactic: 1002 Time: 2.30286 [11/01/2021-13:40:58] [V] [TRT] Tactic: 0 Time: 3.48926 [11/01/2021-13:40:58] [V] [TRT] Fastest Tactic: 1002 Time: 2.30286 [11/01/2021-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:58] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:58] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:58] [V] [TRT] Tactic: 1002 Time: 2.58675 [11/01/2021-13:40:59] [V] [TRT] Tactic: 0 Time: 25.7689 [11/01/2021-13:40:59] [V] [TRT] Fastest Tactic: 1002 Time: 2.58675 [11/01/2021-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:59] [V] [TRT] Tactic: 1002 Time: 5.34267 [11/01/2021-13:40:59] [V] [TRT] Tactic: 0 Time: 11.1848 [11/01/2021-13:40:59] [V] [TRT] Fastest Tactic: 1002 Time: 5.34267 [11/01/2021-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:59] [V] [TRT] Tactic: 1002 Time: 2.5048 [11/01/2021-13:40:59] [V] [TRT] Tactic: 0 Time: 3.57042 [11/01/2021-13:40:59] [V] [TRT] Fastest Tactic: 1002 Time: 2.5048 [11/01/2021-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Cast) [11/01/2021-13:40:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Identity28 (Reformat) [11/01/2021-13:40:59] [V] [TRT] Tactic: 1002 Time: 2.66806 [11/01/2021-13:40:59] [V] [TRT] Tactic: 0 Time: 2.64351 [11/01/2021-13:40:59] [V] [TRT] Fastest Tactic: 0 Time: 2.64351 [11/01/2021-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Transpose30 (Shuffle) [11/01/2021-13:40:59] [V] [TRT] Tactic: 0 Time: 6.88277 [11/01/2021-13:40:59] [V] [TRT] Tactic: 1 Time: 2.63244 [11/01/2021-13:40:59] [V] [TRT] Fastest Tactic: 1 Time: 2.63244 [11/01/2021-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:40:59] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,192) *************** [11/01/2021-13:40:59] [V] [TRT] --------------- Timing Runner: Transpose30 (Shuffle) [11/01/2021-13:41:00] [V] [TRT] Tactic: 0 Time: 15.5386 [11/01/2021-13:41:00] [V] [TRT] Tactic: 1 Time: 4.43829 [11/01/2021-13:41:00] [V] [TRT] Fastest Tactic: 1 Time: 4.43829 [11/01/2021-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] --------------- Timing Runner: Transpose30 (Shuffle) [11/01/2021-13:41:00] [V] [TRT] Tactic: 0 Time: 15.3911 [11/01/2021-13:41:00] [V] [TRT] Tactic: 1 Time: 4.7 [11/01/2021-13:41:00] [V] [TRT] Fastest Tactic: 1 Time: 4.7 [11/01/2021-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] --------------- Timing Runner: batch_normalization_1 (Scale) [11/01/2021-13:41:00] [V] [TRT] Tactic: 0 Time: 2.66633 [11/01/2021-13:41:00] [V] [TRT] Fastest Tactic: 0 Time: 2.66633 [11/01/2021-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:00] [V] [TRT] --------------- Timing Runner: batch_normalization_1 (Scale) [11/01/2021-13:41:00] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:00] [V] [TRT] --------------- Timing Runner: Transpose31 (Shuffle) [11/01/2021-13:41:00] [V] [TRT] Tactic: 0 Time: 5.46376 [11/01/2021-13:41:00] [V] [TRT] Tactic: 1 Time: 2.59642 [11/01/2021-13:41:00] [V] [TRT] Fastest Tactic: 1 Time: 2.59642 [11/01/2021-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:00] [V] [TRT] --------------- Timing Runner: Transpose31 (Shuffle) [11/01/2021-13:41:01] [V] [TRT] Tactic: 0 Time: 19.3602 [11/01/2021-13:41:01] [V] [TRT] Tactic: 1 Time: 4.54026 [11/01/2021-13:41:01] [V] [TRT] Fastest Tactic: 1 Time: 4.54026 [11/01/2021-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning format combination: Float(6144,1024:32,32,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Transpose31 (Shuffle) [11/01/2021-13:41:01] [V] [TRT] Tactic: 0 Time: 14.344 [11/01/2021-13:41:01] [V] [TRT] Tactic: 1 Time: 4.77961 [11/01/2021-13:41:01] [V] [TRT] Fastest Tactic: 1 Time: 4.77961 [11/01/2021-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:01] [V] [TRT] Tactic: 1002 Time: 3.83894 [11/01/2021-13:41:01] [V] [TRT] Tactic: 0 Time: 2.64841 [11/01/2021-13:41:01] [V] [TRT] Fastest Tactic: 0 Time: 2.64841 [11/01/2021-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:01] [V] [TRT] Tactic: 1002 Time: 5.00338 [11/01/2021-13:41:01] [V] [TRT] Tactic: 0 Time: 4.14629 [11/01/2021-13:41:01] [V] [TRT] Fastest Tactic: 0 Time: 4.14629 [11/01/2021-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:01] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:01] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:02] [V] [TRT] Tactic: 1002 Time: 5.09233 [11/01/2021-13:41:02] [V] [TRT] Tactic: 0 Time: 14.2478 [11/01/2021-13:41:02] [V] [TRT] Fastest Tactic: 1002 Time: 5.09233 [11/01/2021-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:02] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:02] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:02] [V] [TRT] Tactic: 1002 Time: 5.33346 [11/01/2021-13:41:02] [V] [TRT] Tactic: 0 Time: 11.5344 [11/01/2021-13:41:02] [V] [TRT] Fastest Tactic: 1002 Time: 5.33346 [11/01/2021-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:02] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:02] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:02] [V] [TRT] Tactic: 1002 Time: 2.45012 [11/01/2021-13:41:02] [V] [TRT] Tactic: 0 Time: 3.5259 [11/01/2021-13:41:02] [V] [TRT] Fastest Tactic: 1002 Time: 2.45012 [11/01/2021-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:02] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:02] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:02] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:02] [V] [TRT] Tactic: 1002 Time: 2.49892 [11/01/2021-13:41:03] [V] [TRT] Tactic: 0 Time: 25.9177 [11/01/2021-13:41:03] [V] [TRT] Fastest Tactic: 1002 Time: 2.49892 [11/01/2021-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:03] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:03] [V] [TRT] Tactic: 1002 Time: 5.46781 [11/01/2021-13:41:03] [V] [TRT] Tactic: 0 Time: 10.8669 [11/01/2021-13:41:03] [V] [TRT] Fastest Tactic: 1002 Time: 5.46781 [11/01/2021-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:03] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:03] [V] [TRT] Tactic: 1002 Time: 2.48851 [11/01/2021-13:41:03] [V] [TRT] Tactic: 0 Time: 3.74231 [11/01/2021-13:41:03] [V] [TRT] Fastest Tactic: 1002 Time: 2.48851 [11/01/2021-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Cast) [11/01/2021-13:41:03] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: Identity27 (Reformat) [11/01/2021-13:41:03] [V] [TRT] Tactic: 1002 Time: 2.56807 [11/01/2021-13:41:03] [V] [TRT] Tactic: 0 Time: 2.65665 [11/01/2021-13:41:03] [V] [TRT] Fastest Tactic: 1002 Time: 2.56807 [11/01/2021-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:03] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:03] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWiseV2) [11/01/2021-13:41:03] [V] [TRT] Tactic: 0 Time: 3.52401 [11/01/2021-13:41:03] [V] [TRT] Tactic: 1 Time: 2.88598 [11/01/2021-13:41:04] [V] [TRT] Tactic: 2 Time: 2.48799 [11/01/2021-13:41:04] [V] [TRT] Tactic: 3 Time: 2.75635 [11/01/2021-13:41:04] [V] [TRT] Tactic: 4 Time: 2.31596 [11/01/2021-13:41:04] [V] [TRT] Tactic: 5 Time: 2.45508 [11/01/2021-13:41:04] [V] [TRT] Tactic: 6 Time: 2.65907 [11/01/2021-13:41:04] [V] [TRT] Tactic: 7 Time: 2.33152 [11/01/2021-13:41:04] [V] [TRT] Tactic: 8 Time: 2.23054 [11/01/2021-13:41:04] [V] [TRT] Tactic: 9 Time: 2.25296 [11/01/2021-13:41:04] [V] [TRT] Tactic: 28 Time: 3.4928 [11/01/2021-13:41:04] [V] [TRT] Fastest Tactic: 8 Time: 2.23054 [11/01/2021-13:41:04] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWise) [11/01/2021-13:41:04] [V] [TRT] Tactic: 128 Time: 13.3046 [11/01/2021-13:41:05] [V] [TRT] Tactic: 256 Time: 12.8925 [11/01/2021-13:41:05] [V] [TRT] Tactic: 512 Time: 12.7617 [11/01/2021-13:41:05] [V] [TRT] Fastest Tactic: 512 Time: 12.7617 [11/01/2021-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [11/01/2021-13:41:05] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:05] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWiseV2) [11/01/2021-13:41:05] [V] [TRT] Tactic: 0 Time: 3.51314 [11/01/2021-13:41:05] [V] [TRT] Tactic: 1 Time: 2.8864 [11/01/2021-13:41:05] [V] [TRT] Tactic: 2 Time: 2.57956 [11/01/2021-13:41:05] [V] [TRT] Tactic: 3 Time: 2.71473 [11/01/2021-13:41:05] [V] [TRT] Tactic: 4 Time: 2.32717 [11/01/2021-13:41:05] [V] [TRT] Tactic: 5 Time: 2.36276 [11/01/2021-13:41:05] [V] [TRT] Tactic: 6 Time: 2.66189 [11/01/2021-13:41:05] [V] [TRT] Tactic: 7 Time: 2.26801 [11/01/2021-13:41:05] [V] [TRT] Tactic: 8 Time: 2.28838 [11/01/2021-13:41:05] [V] [TRT] Tactic: 9 Time: 2.26543 [11/01/2021-13:41:05] [V] [TRT] Tactic: 28 Time: 3.49348 [11/01/2021-13:41:05] [V] [TRT] Fastest Tactic: 9 Time: 2.26543 [11/01/2021-13:41:05] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWise) [11/01/2021-13:41:06] [V] [TRT] Tactic: 128 Time: 13.167 [11/01/2021-13:41:06] [V] [TRT] Tactic: 256 Time: 13.0165 [11/01/2021-13:41:06] [V] [TRT] Tactic: 512 Time: 12.9446 [11/01/2021-13:41:06] [V] [TRT] Fastest Tactic: 512 Time: 12.9446 [11/01/2021-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [11/01/2021-13:41:06] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:06] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWiseV2) [11/01/2021-13:41:06] [V] [TRT] Tactic: 24 Time: 3.54307 [11/01/2021-13:41:06] [V] [TRT] Tactic: 25 Time: 3.51524 [11/01/2021-13:41:06] [V] [TRT] Tactic: 26 Time: 3.42479 [11/01/2021-13:41:06] [V] [TRT] Tactic: 27 Time: 3.49173 [11/01/2021-13:41:07] [V] [TRT] Tactic: 31 Time: 3.57009 [11/01/2021-13:41:07] [V] [TRT] Fastest Tactic: 26 Time: 3.42479 [11/01/2021-13:41:07] [V] [TRT] --------------- Timing Runner: PWN(elu_1) (PointWise) [11/01/2021-13:41:07] [V] [TRT] Tactic: 128 Time: 13.2935 [11/01/2021-13:41:07] [V] [TRT] Tactic: 256 Time: 13.3356 [11/01/2021-13:41:07] [V] [TRT] Tactic: 512 Time: 12.7029 [11/01/2021-13:41:07] [V] [TRT] Fastest Tactic: 512 Time: 12.7029 [11/01/2021-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:07] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:07] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:07] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:07] [V] [TRT] Tactic: 1002 Time: 3.85505 [11/01/2021-13:41:07] [V] [TRT] Tactic: 0 Time: 2.61292 [11/01/2021-13:41:07] [V] [TRT] Fastest Tactic: 0 Time: 2.61292 [11/01/2021-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:07] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:07] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:07] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:07] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:08] [V] [TRT] Tactic: 1002 Time: 4.98244 [11/01/2021-13:41:08] [V] [TRT] Tactic: 0 Time: 4.13658 [11/01/2021-13:41:08] [V] [TRT] Fastest Tactic: 0 Time: 4.13658 [11/01/2021-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:08] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:08] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:08] [V] [TRT] Tactic: 1002 Time: 5.02996 [11/01/2021-13:41:08] [V] [TRT] Tactic: 0 Time: 14.6707 [11/01/2021-13:41:08] [V] [TRT] Fastest Tactic: 1002 Time: 5.02996 [11/01/2021-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:08] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:08] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:08] [V] [TRT] Tactic: 1002 Time: 5.57898 [11/01/2021-13:41:08] [V] [TRT] Tactic: 0 Time: 11.1195 [11/01/2021-13:41:08] [V] [TRT] Fastest Tactic: 1002 Time: 5.57898 [11/01/2021-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:08] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:08] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:08] [V] [TRT] Tactic: 1002 Time: 2.37619 [11/01/2021-13:41:08] [V] [TRT] Tactic: 0 Time: 3.47771 [11/01/2021-13:41:08] [V] [TRT] Fastest Tactic: 1002 Time: 2.37619 [11/01/2021-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:08] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:08] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:08] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:08] [V] [TRT] Tactic: 1002 Time: 2.65967 [11/01/2021-13:41:09] [V] [TRT] Tactic: 0 Time: 26.4711 [11/01/2021-13:41:09] [V] [TRT] Fastest Tactic: 1002 Time: 2.65967 [11/01/2021-13:41:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:09] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:09] [V] [TRT] Tactic: 1002 Time: 5.54977 [11/01/2021-13:41:09] [V] [TRT] Tactic: 0 Time: 11.3463 [11/01/2021-13:41:09] [V] [TRT] Fastest Tactic: 1002 Time: 5.54977 [11/01/2021-13:41:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:09] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:09] [V] [TRT] Tactic: 1002 Time: 2.42449 [11/01/2021-13:41:09] [V] [TRT] Tactic: 0 Time: 3.57869 [11/01/2021-13:41:09] [V] [TRT] Fastest Tactic: 1002 Time: 2.42449 [11/01/2021-13:41:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Cast) [11/01/2021-13:41:09] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Identity26 (Reformat) [11/01/2021-13:41:09] [V] [TRT] Tactic: 1002 Time: 2.60657 [11/01/2021-13:41:09] [V] [TRT] Tactic: 0 Time: 2.6716 [11/01/2021-13:41:09] [V] [TRT] Fastest Tactic: 1002 Time: 2.60657 [11/01/2021-13:41:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:41:09] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:09] [V] [TRT] --------------- Timing Runner: Transpose28 (Shuffle) [11/01/2021-13:41:10] [V] [TRT] Tactic: 0 Time: 6.58577 [11/01/2021-13:41:10] [V] [TRT] Tactic: 1 Time: 2.58337 [11/01/2021-13:41:10] [V] [TRT] Fastest Tactic: 1 Time: 2.58337 [11/01/2021-13:41:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:10] [V] [TRT] --------------- Timing Runner: Transpose28 (Shuffle) [11/01/2021-13:41:10] [V] [TRT] Tactic: 0 Time: 15.7365 [11/01/2021-13:41:10] [V] [TRT] Tactic: 1 Time: 4.4497 [11/01/2021-13:41:10] [V] [TRT] Fastest Tactic: 1 Time: 4.4497 [11/01/2021-13:41:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:41:10] [V] [TRT] --------------- Timing Runner: Transpose28 (Shuffle) [11/01/2021-13:41:10] [V] [TRT] Tactic: 0 Time: 15.7157 [11/01/2021-13:41:10] [V] [TRT] Tactic: 1 Time: 4.71343 [11/01/2021-13:41:10] [V] [TRT] Fastest Tactic: 1 Time: 4.71343 [11/01/2021-13:41:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:41:10] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:10] [V] [TRT] --------------- Timing Runner: conv2d_2 (CudaDepthwiseConvolution) [11/01/2021-13:41:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [11/01/2021-13:41:10] [V] [TRT] --------------- Timing Runner: conv2d_2 (CudnnConvolution) [11/01/2021-13:41:11] [V] [TRT] Tactic: 0 Time: 39.592 [11/01/2021-13:41:12] [V] [TRT] Tactic: 1 Time: 32.8443 [11/01/2021-13:41:12] [V] [TRT] Tactic: 2 Time: 42.2148 [11/01/2021-13:41:14] [V] [TRT] Tactic: 5 Time: 115.924 [11/01/2021-13:41:15] [V] [TRT] Tactic: 56 Time: 38.8797 [11/01/2021-13:41:16] [V] [TRT] Tactic: 57 Time: 33.2504 [11/01/2021-13:41:16] [V] [TRT] Tactic: 58 Time: 39.5704 [11/01/2021-13:41:18] [V] [TRT] Tactic: 61 Time: 117.152 [11/01/2021-13:41:18] [V] [TRT] Fastest Tactic: 1 Time: 32.8443 [11/01/2021-13:41:18] [V] [TRT] --------------- Timing Runner: conv2d_2 (CaskConvolution) [11/01/2021-13:41:18] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384 [11/01/2021-13:41:19] [V] [TRT] Tactic: 1825138533642645384 Time: 26.9073 [11/01/2021-13:41:19] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458 [11/01/2021-13:41:19] [V] [TRT] Tactic: 2842488832350522458 Time: 28.0346 [11/01/2021-13:41:19] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238 [11/01/2021-13:41:20] [V] [TRT] Tactic: 3915320020053085238 Time: 26.9171 [11/01/2021-13:41:20] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203 [11/01/2021-13:41:20] [V] [TRT] Tactic: 6448355332020552203 Time: 29.8431 [11/01/2021-13:41:20] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604 [11/01/2021-13:41:20] [V] [TRT] Tactic: 6808617066150061604 Time: 28.4349 [11/01/2021-13:41:20] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864 [11/01/2021-13:41:21] [V] [TRT] Tactic: -8060443123034038864 Time: 28.3568 [11/01/2021-13:41:21] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522 [11/01/2021-13:41:22] [V] [TRT] Tactic: -4420849921117327522 Time: 34.2236 [11/01/2021-13:41:22] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337 [11/01/2021-13:41:22] [V] [TRT] Tactic: -3946921629105938337 Time: 30.5087 [11/01/2021-13:41:22] [V] [TRT] Fastest Tactic: 1825138533642645384 Time: 26.9073 [11/01/2021-13:41:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1825138533642645384 [11/01/2021-13:41:22] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:22] [V] [TRT] --------------- Timing Runner: conv2d_2 (CudnnConvolution) [11/01/2021-13:41:22] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [11/01/2021-13:41:22] [V] [TRT] --------------- Timing Runner: conv2d_2 (CaskConvolution) [11/01/2021-13:41:22] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [11/01/2021-13:41:23] [V] [TRT] Tactic: 861694390046228376 Time: 27.2606 [11/01/2021-13:41:23] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567 [11/01/2021-13:41:23] [V] [TRT] Tactic: 1017870653102653567 Time: 27.3431 [11/01/2021-13:41:23] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167 [11/01/2021-13:41:23] [V] [TRT] Tactic: 5258189349241541167 Time: 27.5932 [11/01/2021-13:41:23] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [11/01/2021-13:41:24] [V] [TRT] Tactic: 5821621277990374316 Time: 27.7079 [11/01/2021-13:41:24] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648 [11/01/2021-13:41:24] [V] [TRT] Tactic: 5863767799113001648 Time: 28.6254 [11/01/2021-13:41:24] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536 [11/01/2021-13:41:25] [V] [TRT] Tactic: -9147980667639709536 Time: 27.4319 [11/01/2021-13:41:25] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857 [11/01/2021-13:41:25] [V] [TRT] Tactic: -8850904373104590857 Time: 28.4318 [11/01/2021-13:41:25] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660 [11/01/2021-13:41:26] [V] [TRT] Tactic: -7751035352149795660 Time: 27.0112 [11/01/2021-13:41:26] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [11/01/2021-13:41:26] [V] [TRT] Tactic: -3853827649136781465 Time: 27.7333 [11/01/2021-13:41:26] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196 [11/01/2021-13:41:27] [V] [TRT] Tactic: -3263369460438823196 Time: 27.4412 [11/01/2021-13:41:27] [V] [TRT] conv2d_2 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819 [11/01/2021-13:41:27] [V] [TRT] Tactic: -423878181466897819 Time: 28.8457 [11/01/2021-13:41:27] [V] [TRT] Fastest Tactic: -7751035352149795660 Time: 27.0112 [11/01/2021-13:41:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7751035352149795660 [11/01/2021-13:41:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:27] [V] [TRT] Tactic: 1002 Time: 0.931364 [11/01/2021-13:41:27] [V] [TRT] Tactic: 0 Time: 1.82733 [11/01/2021-13:41:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.931364 [11/01/2021-13:41:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:27] [V] [TRT] Tactic: 1002 Time: 0.835772 [11/01/2021-13:41:27] [V] [TRT] Tactic: 0 Time: 4.65353 [11/01/2021-13:41:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.835772 [11/01/2021-13:41:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:27] [V] [TRT] Tactic: 1002 Time: 1.55125 [11/01/2021-13:41:27] [V] [TRT] Tactic: 0 Time: 1.80466 [11/01/2021-13:41:27] [V] [TRT] Fastest Tactic: 1002 Time: 1.55125 [11/01/2021-13:41:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:27] [V] [TRT] Tactic: 1002 Time: 0.81778 [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 5.2512 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.81778 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:28] [V] [TRT] Tactic: 1002 Time: 1.4482 [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 1.82298 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.4482 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:28] [V] [TRT] Tactic: 1002 Time: 0.808492 [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 1.14282 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.808492 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Transpose29 (Shuffle) [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 1.81875 [11/01/2021-13:41:28] [V] [TRT] Tactic: 1 Time: 0.79404 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1 Time: 0.79404 [11/01/2021-13:41:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Transpose29 (Shuffle) [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 2.62361 [11/01/2021-13:41:28] [V] [TRT] Tactic: 1 Time: 3.03632 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 0 Time: 2.62361 [11/01/2021-13:41:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Transpose29 (Shuffle) [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 9.58041 [11/01/2021-13:41:28] [V] [TRT] Tactic: 1 Time: 3.47002 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1 Time: 3.47002 [11/01/2021-13:41:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:28] [V] [TRT] Tactic: 1002 Time: 3.30687 [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 1.0288 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 0 Time: 1.0288 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:28] [V] [TRT] Tactic: 1002 Time: 3.2908 [11/01/2021-13:41:28] [V] [TRT] Tactic: 0 Time: 9.13818 [11/01/2021-13:41:28] [V] [TRT] Fastest Tactic: 1002 Time: 3.2908 [11/01/2021-13:41:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 3.52547 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 1.99413 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 0 Time: 1.99413 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 1.8538 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 10.1817 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 1002 Time: 1.8538 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 3.37278 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 2.61909 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 0 Time: 2.61909 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 1.86707 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 1.22436 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 0 Time: 1.22436 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 1.30842 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 0.7796 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 0 Time: 0.7796 [11/01/2021-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 3.32498 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 1.0103 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 0 Time: 1.0103 [11/01/2021-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:29] [V] [TRT] Tactic: 1002 Time: 3.33165 [11/01/2021-13:41:29] [V] [TRT] Tactic: 0 Time: 9.28214 [11/01/2021-13:41:29] [V] [TRT] Fastest Tactic: 1002 Time: 3.33165 [11/01/2021-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:29] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:29] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 3.36856 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 2.10802 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 0 Time: 2.10802 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 0.751892 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 0.96488 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.751892 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 1.91644 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 10.2929 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 1002 Time: 1.91644 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 3.41042 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 2.74401 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 0 Time: 2.74401 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 1.86881 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 1.12841 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 0 Time: 1.12841 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Cast) [11/01/2021-13:41:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Identity25 (Reformat) [11/01/2021-13:41:30] [V] [TRT] Tactic: 1002 Time: 1.84184 [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 12.0942 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 1002 Time: 1.84184 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Transpose26 (Shuffle) [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 1.80704 [11/01/2021-13:41:30] [V] [TRT] Tactic: 1 Time: 0.7958 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 1 Time: 0.7958 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Transpose26 (Shuffle) [11/01/2021-13:41:30] [V] [TRT] Tactic: 0 Time: 2.04467 [11/01/2021-13:41:30] [V] [TRT] Tactic: 1 Time: 3.0621 [11/01/2021-13:41:30] [V] [TRT] Fastest Tactic: 0 Time: 2.04467 [11/01/2021-13:41:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:41:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:30] [V] [TRT] --------------- Timing Runner: Transpose26 (Shuffle) [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 4.5642 [11/01/2021-13:41:31] [V] [TRT] Tactic: 1 Time: 3.23779 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 1 Time: 3.23779 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: batch_normalization_2 (Scale) [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 0.754264 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 0 Time: 0.754264 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: batch_normalization_2 (Scale) [11/01/2021-13:41:31] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Transpose27 (Shuffle) [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 1.81528 [11/01/2021-13:41:31] [V] [TRT] Tactic: 1 Time: 0.809772 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 1 Time: 0.809772 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Transpose27 (Shuffle) [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 2.52208 [11/01/2021-13:41:31] [V] [TRT] Tactic: 1 Time: 3.03263 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 0 Time: 2.52208 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Transpose27 (Shuffle) [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 9.57878 [11/01/2021-13:41:31] [V] [TRT] Tactic: 1 Time: 3.21732 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 1 Time: 3.21732 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:31] [V] [TRT] Tactic: 1002 Time: 1.27523 [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 0.794044 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 0 Time: 0.794044 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:31] [V] [TRT] Tactic: 1002 Time: 3.3615 [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 1.02724 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 0 Time: 1.02724 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:31] [V] [TRT] Tactic: 1002 Time: 3.37602 [11/01/2021-13:41:31] [V] [TRT] Tactic: 0 Time: 8.90603 [11/01/2021-13:41:31] [V] [TRT] Fastest Tactic: 1002 Time: 3.37602 [11/01/2021-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:31] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 3.36778 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 2.04406 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 0 Time: 2.04406 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:32] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 0.817068 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 0.935512 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.817068 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:32] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 1.71784 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 10.1377 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 1002 Time: 1.71784 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:32] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 3.37036 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 2.69081 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 0 Time: 2.69081 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:32] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 1.86771 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 1.09831 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 0 Time: 1.09831 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Cast) [11/01/2021-13:41:32] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: Identity24 (Reformat) [11/01/2021-13:41:32] [V] [TRT] Tactic: 1002 Time: 1.90639 [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 12.0883 [11/01/2021-13:41:32] [V] [TRT] Fastest Tactic: 1002 Time: 1.90639 [11/01/2021-13:41:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:32] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:32] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWiseV2) [11/01/2021-13:41:32] [V] [TRT] Tactic: 0 Time: 0.889576 [11/01/2021-13:41:32] [V] [TRT] Tactic: 1 Time: 0.919488 [11/01/2021-13:41:32] [V] [TRT] Tactic: 2 Time: 0.740016 [11/01/2021-13:41:32] [V] [TRT] Tactic: 3 Time: 0.821148 [11/01/2021-13:41:32] [V] [TRT] Tactic: 4 Time: 0.7329 [11/01/2021-13:41:32] [V] [TRT] Tactic: 5 Time: 0.73312 [11/01/2021-13:41:32] [V] [TRT] Tactic: 6 Time: 0.816684 [11/01/2021-13:41:33] [V] [TRT] Tactic: 7 Time: 0.709476 [11/01/2021-13:41:33] [V] [TRT] Tactic: 8 Time: 0.735704 [11/01/2021-13:41:33] [V] [TRT] Tactic: 9 Time: 0.741236 [11/01/2021-13:41:33] [V] [TRT] Tactic: 28 Time: 0.870808 [11/01/2021-13:41:33] [V] [TRT] Fastest Tactic: 7 Time: 0.709476 [11/01/2021-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWise) [11/01/2021-13:41:33] [V] [TRT] Tactic: 128 Time: 4.21296 [11/01/2021-13:41:33] [V] [TRT] Tactic: 256 Time: 4.21083 [11/01/2021-13:41:33] [V] [TRT] Tactic: 512 Time: 4.21365 [11/01/2021-13:41:33] [V] [TRT] Fastest Tactic: 256 Time: 4.21083 [11/01/2021-13:41:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [11/01/2021-13:41:33] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWiseV2) [11/01/2021-13:41:33] [V] [TRT] Tactic: 0 Time: 0.883532 [11/01/2021-13:41:33] [V] [TRT] Tactic: 1 Time: 0.839972 [11/01/2021-13:41:33] [V] [TRT] Tactic: 2 Time: 0.748672 [11/01/2021-13:41:33] [V] [TRT] Tactic: 3 Time: 0.82532 [11/01/2021-13:41:33] [V] [TRT] Tactic: 4 Time: 0.735072 [11/01/2021-13:41:33] [V] [TRT] Tactic: 5 Time: 0.740708 [11/01/2021-13:41:33] [V] [TRT] Tactic: 6 Time: 0.817976 [11/01/2021-13:41:33] [V] [TRT] Tactic: 7 Time: 0.747348 [11/01/2021-13:41:33] [V] [TRT] Tactic: 8 Time: 0.73974 [11/01/2021-13:41:33] [V] [TRT] Tactic: 9 Time: 0.741332 [11/01/2021-13:41:33] [V] [TRT] Tactic: 28 Time: 0.880892 [11/01/2021-13:41:33] [V] [TRT] Fastest Tactic: 4 Time: 0.735072 [11/01/2021-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWise) [11/01/2021-13:41:33] [V] [TRT] Tactic: 128 Time: 4.40404 [11/01/2021-13:41:33] [V] [TRT] Tactic: 256 Time: 4.21649 [11/01/2021-13:41:33] [V] [TRT] Tactic: 512 Time: 4.22049 [11/01/2021-13:41:33] [V] [TRT] Fastest Tactic: 256 Time: 4.21649 [11/01/2021-13:41:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [11/01/2021-13:41:33] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWiseV2) [11/01/2021-13:41:34] [V] [TRT] Tactic: 24 Time: 2.30883 [11/01/2021-13:41:35] [V] [TRT] Tactic: 25 Time: 2.44262 [11/01/2021-13:41:35] [V] [TRT] Tactic: 26 Time: 2.26501 [11/01/2021-13:41:36] [V] [TRT] Tactic: 27 Time: 2.27647 [11/01/2021-13:41:37] [V] [TRT] Tactic: 31 Time: 2.34249 [11/01/2021-13:41:37] [V] [TRT] Fastest Tactic: 26 Time: 2.26501 [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: PWN(elu_2) (PointWise) [11/01/2021-13:41:37] [V] [TRT] Tactic: 128 Time: 8.74957 [11/01/2021-13:41:37] [V] [TRT] Tactic: 256 Time: 8.69841 [11/01/2021-13:41:37] [V] [TRT] Tactic: 512 Time: 9.12168 [11/01/2021-13:41:37] [V] [TRT] Fastest Tactic: 256 Time: 8.69841 [11/01/2021-13:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: Transpose24 (Shuffle) [11/01/2021-13:41:37] [V] [TRT] Tactic: 0 Time: 1.83024 [11/01/2021-13:41:37] [V] [TRT] Tactic: 1 Time: 0.79802 [11/01/2021-13:41:37] [V] [TRT] Fastest Tactic: 1 Time: 0.79802 [11/01/2021-13:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: Transpose24 (Shuffle) [11/01/2021-13:41:37] [V] [TRT] Tactic: 0 Time: 1.97844 [11/01/2021-13:41:37] [V] [TRT] Tactic: 1 Time: 3.01072 [11/01/2021-13:41:37] [V] [TRT] Fastest Tactic: 0 Time: 1.97844 [11/01/2021-13:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: Transpose24 (Shuffle) [11/01/2021-13:41:37] [V] [TRT] Tactic: 0 Time: 4.57111 [11/01/2021-13:41:37] [V] [TRT] Tactic: 1 Time: 3.26507 [11/01/2021-13:41:37] [V] [TRT] Fastest Tactic: 1 Time: 3.26507 [11/01/2021-13:41:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:37] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: conv2d_3 (CudaDepthwiseConvolution) [11/01/2021-13:41:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: conv2d_3 (FusedConvActConvolution) [11/01/2021-13:41:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [11/01/2021-13:41:37] [V] [TRT] --------------- Timing Runner: conv2d_3 (CudnnConvolution) [11/01/2021-13:41:38] [V] [TRT] Tactic: 0 Time: 47.7278 [11/01/2021-13:41:39] [V] [TRT] Tactic: 1 Time: 42.4716 [11/01/2021-13:41:40] [V] [TRT] Tactic: 2 Time: 46.8273 [11/01/2021-13:41:40] [V] [TRT] Tactic: 4 Time: 48.2207 [11/01/2021-13:41:41] [V] [TRT] Tactic: 5 Time: 40.99 [11/01/2021-13:41:42] [V] [TRT] Tactic: 6 Time: 20.8755 [11/01/2021-13:41:42] [V] [TRT] Tactic: 56 Time: 48.1808 [11/01/2021-13:41:43] [V] [TRT] Tactic: 57 Time: 43.6168 [11/01/2021-13:41:44] [V] [TRT] Tactic: 58 Time: 47.5996 [11/01/2021-13:41:45] [V] [TRT] Tactic: 60 Time: 48.7771 [11/01/2021-13:41:45] [V] [TRT] Tactic: 61 Time: 40.5277 [11/01/2021-13:41:46] [V] [TRT] Tactic: 62 Time: 20.6453 [11/01/2021-13:41:46] [V] [TRT] Fastest Tactic: 62 Time: 20.6453 [11/01/2021-13:41:46] [V] [TRT] --------------- Timing Runner: conv2d_3 (CaskConvolution) [11/01/2021-13:41:46] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384 [11/01/2021-13:41:46] [V] [TRT] Tactic: 1825138533642645384 Time: 36.4979 [11/01/2021-13:41:46] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 2775507031594384867 [11/01/2021-13:41:47] [V] [TRT] Tactic: 2775507031594384867 Time: 19.2401 [11/01/2021-13:41:47] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458 [11/01/2021-13:41:47] [V] [TRT] Tactic: 2842488832350522458 Time: 37.1669 [11/01/2021-13:41:47] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238 [11/01/2021-13:41:48] [V] [TRT] Tactic: 3915320020053085238 Time: 36.5195 [11/01/2021-13:41:48] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203 [11/01/2021-13:41:49] [V] [TRT] Tactic: 6448355332020552203 Time: 40.1811 [11/01/2021-13:41:49] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604 [11/01/2021-13:41:49] [V] [TRT] Tactic: 6808617066150061604 Time: 37.8872 [11/01/2021-13:41:49] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864 [11/01/2021-13:41:50] [V] [TRT] Tactic: -8060443123034038864 Time: 37.7099 [11/01/2021-13:41:50] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522 [11/01/2021-13:41:51] [V] [TRT] Tactic: -4420849921117327522 Time: 42.9988 [11/01/2021-13:41:51] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337 [11/01/2021-13:41:51] [V] [TRT] Tactic: -3946921629105938337 Time: 41.0919 [11/01/2021-13:41:51] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 19.2401 [11/01/2021-13:41:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [11/01/2021-13:41:51] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:51] [V] [TRT] --------------- Timing Runner: conv2d_3 (CudnnConvolution) [11/01/2021-13:41:51] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [11/01/2021-13:41:51] [V] [TRT] --------------- Timing Runner: conv2d_3 (CaskConvolution) [11/01/2021-13:41:51] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [11/01/2021-13:41:52] [V] [TRT] Tactic: 861694390046228376 Time: 35.9653 [11/01/2021-13:41:52] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567 [11/01/2021-13:41:52] [V] [TRT] Tactic: 1017870653102653567 Time: 35.712 [11/01/2021-13:41:52] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167 [11/01/2021-13:41:53] [V] [TRT] Tactic: 5258189349241541167 Time: 37.0209 [11/01/2021-13:41:53] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [11/01/2021-13:41:54] [V] [TRT] Tactic: 5821621277990374316 Time: 36.2538 [11/01/2021-13:41:54] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648 [11/01/2021-13:41:54] [V] [TRT] Tactic: 5863767799113001648 Time: 38.1528 [11/01/2021-13:41:54] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536 [11/01/2021-13:41:55] [V] [TRT] Tactic: -9147980667639709536 Time: 35.923 [11/01/2021-13:41:55] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857 [11/01/2021-13:41:55] [V] [TRT] Tactic: -8850904373104590857 Time: 37.6649 [11/01/2021-13:41:55] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660 [11/01/2021-13:41:56] [V] [TRT] Tactic: -7751035352149795660 Time: 35.9255 [11/01/2021-13:41:56] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [11/01/2021-13:41:57] [V] [TRT] Tactic: -3853827649136781465 Time: 36.2348 [11/01/2021-13:41:57] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196 [11/01/2021-13:41:57] [V] [TRT] Tactic: -3263369460438823196 Time: 36.6234 [11/01/2021-13:41:57] [V] [TRT] conv2d_3 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819 [11/01/2021-13:41:58] [V] [TRT] Tactic: -423878181466897819 Time: 37.53 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 1017870653102653567 Time: 35.712 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1017870653102653567 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Transpose25 (Shuffle) [11/01/2021-13:41:58] [V] [TRT] Tactic: 0 Time: 1.80369 [11/01/2021-13:41:58] [V] [TRT] Tactic: 1 Time: 0.794316 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 1 Time: 0.794316 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Transpose25 (Shuffle) [11/01/2021-13:41:58] [V] [TRT] Tactic: 0 Time: 2.5099 [11/01/2021-13:41:58] [V] [TRT] Tactic: 1 Time: 3.1328 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 0 Time: 2.5099 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Transpose25 (Shuffle) [11/01/2021-13:41:58] [V] [TRT] Tactic: 0 Time: 8.98679 [11/01/2021-13:41:58] [V] [TRT] Tactic: 1 Time: 3.22292 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 1 Time: 3.22292 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:58] [V] [TRT] Tactic: 1002 Time: 1.27856 [11/01/2021-13:41:58] [V] [TRT] Tactic: 0 Time: 0.815892 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 0 Time: 0.815892 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:58] [V] [TRT] Tactic: 1002 Time: 3.30092 [11/01/2021-13:41:58] [V] [TRT] Tactic: 0 Time: 1.03966 [11/01/2021-13:41:58] [V] [TRT] Fastest Tactic: 0 Time: 1.03966 [11/01/2021-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:58] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:58] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:58] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 3.29196 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 9.02692 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 1002 Time: 3.29196 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 3.39836 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 2.00127 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 0 Time: 2.00127 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 0.745428 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 0.943108 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.745428 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 1.76094 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 10.1894 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 1002 Time: 1.76094 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 3.70521 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 2.81639 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 0 Time: 2.81639 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 1.86718 [11/01/2021-13:41:59] [V] [TRT] Tactic: 0 Time: 1.09976 [11/01/2021-13:41:59] [V] [TRT] Fastest Tactic: 0 Time: 1.09976 [11/01/2021-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:41:59] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Cast) [11/01/2021-13:41:59] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:41:59] [V] [TRT] --------------- Timing Runner: Identity23 (Reformat) [11/01/2021-13:41:59] [V] [TRT] Tactic: 1002 Time: 1.84057 [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 11.945 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 1002 Time: 1.84057 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose22 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 1.82124 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 0.792164 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 1 Time: 0.792164 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose22 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 1.98632 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 3.01858 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 0 Time: 1.98632 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose22 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 4.57886 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 3.25282 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 1 Time: 3.25282 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: batch_normalization_3 (Scale) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 0.746152 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.746152 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: batch_normalization_3 (Scale) [11/01/2021-13:42:00] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose23 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 1.8033 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 0.796664 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 1 Time: 0.796664 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose23 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 2.52036 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 3.03394 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 0 Time: 2.52036 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Transpose23 (Shuffle) [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 9.50231 [11/01/2021-13:42:00] [V] [TRT] Tactic: 1 Time: 3.21557 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 1 Time: 3.21557 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:00] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:00] [V] [TRT] Tactic: 1002 Time: 1.27117 [11/01/2021-13:42:00] [V] [TRT] Tactic: 0 Time: 0.783972 [11/01/2021-13:42:00] [V] [TRT] Fastest Tactic: 0 Time: 0.783972 [11/01/2021-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:00] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:00] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:00] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 3.35986 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 1.0671 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 0 Time: 1.0671 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 3.2868 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 8.86149 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 3.2868 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 3.37272 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 2.13448 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 0 Time: 2.13448 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 0.750012 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 0.946732 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.750012 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 1.87235 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 10.0985 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 1.87235 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 3.37076 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 2.69004 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 0 Time: 2.69004 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 1.8734 [11/01/2021-13:42:01] [V] [TRT] Tactic: 0 Time: 1.16572 [11/01/2021-13:42:01] [V] [TRT] Fastest Tactic: 0 Time: 1.16572 [11/01/2021-13:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:01] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Cast) [11/01/2021-13:42:01] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:01] [V] [TRT] --------------- Timing Runner: Identity22 (Reformat) [11/01/2021-13:42:01] [V] [TRT] Tactic: 1002 Time: 1.84806 [11/01/2021-13:42:02] [V] [TRT] Tactic: 0 Time: 12.3866 [11/01/2021-13:42:02] [V] [TRT] Fastest Tactic: 1002 Time: 1.84806 [11/01/2021-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:02] [V] [TRT] --------------- Timing Runner: Transpose20 (Shuffle) [11/01/2021-13:42:02] [V] [TRT] Tactic: 0 Time: 1.87298 [11/01/2021-13:42:02] [V] [TRT] Tactic: 1 Time: 0.779608 [11/01/2021-13:42:02] [V] [TRT] Fastest Tactic: 1 Time: 0.779608 [11/01/2021-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:02] [V] [TRT] --------------- Timing Runner: Transpose20 (Shuffle) [11/01/2021-13:42:02] [V] [TRT] Tactic: 0 Time: 2.04536 [11/01/2021-13:42:02] [V] [TRT] Tactic: 1 Time: 3.01065 [11/01/2021-13:42:02] [V] [TRT] Fastest Tactic: 0 Time: 2.04536 [11/01/2021-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:02] [V] [TRT] --------------- Timing Runner: Transpose20 (Shuffle) [11/01/2021-13:42:02] [V] [TRT] Tactic: 0 Time: 4.56819 [11/01/2021-13:42:02] [V] [TRT] Tactic: 1 Time: 3.2657 [11/01/2021-13:42:02] [V] [TRT] Fastest Tactic: 1 Time: 3.2657 [11/01/2021-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:02] [V] [TRT] --------------- Timing Runner: conv2d_4 (CudaDepthwiseConvolution) [11/01/2021-13:42:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [11/01/2021-13:42:02] [V] [TRT] --------------- Timing Runner: conv2d_4 (CudnnConvolution) [11/01/2021-13:42:02] [V] [TRT] Tactic: 0 Time: 19.0991 [11/01/2021-13:42:03] [V] [TRT] Tactic: 1 Time: 16.3192 [11/01/2021-13:42:03] [V] [TRT] Tactic: 2 Time: 18.3955 [11/01/2021-13:42:04] [V] [TRT] Tactic: 5 Time: 60.1833 [11/01/2021-13:42:04] [V] [TRT] Tactic: 56 Time: 18.9512 [11/01/2021-13:42:05] [V] [TRT] Tactic: 57 Time: 16.4367 [11/01/2021-13:42:05] [V] [TRT] Tactic: 58 Time: 18.2645 [11/01/2021-13:42:06] [V] [TRT] Tactic: 61 Time: 59.5007 [11/01/2021-13:42:06] [V] [TRT] Fastest Tactic: 1 Time: 16.3192 [11/01/2021-13:42:06] [V] [TRT] --------------- Timing Runner: conv2d_4 (CaskConvolution) [11/01/2021-13:42:06] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 1825138533642645384 [11/01/2021-13:42:06] [V] [TRT] Tactic: 1825138533642645384 Time: 13.2722 [11/01/2021-13:42:06] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 2842488832350522458 [11/01/2021-13:42:06] [V] [TRT] Tactic: 2842488832350522458 Time: 13.9934 [11/01/2021-13:42:06] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 3915320020053085238 [11/01/2021-13:42:07] [V] [TRT] Tactic: 3915320020053085238 Time: 13.7829 [11/01/2021-13:42:07] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6448355332020552203 [11/01/2021-13:42:07] [V] [TRT] Tactic: 6448355332020552203 Time: 14.0535 [11/01/2021-13:42:07] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 6808617066150061604 [11/01/2021-13:42:07] [V] [TRT] Tactic: 6808617066150061604 Time: 14.1947 [11/01/2021-13:42:07] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: -8060443123034038864 [11/01/2021-13:42:07] [V] [TRT] Tactic: -8060443123034038864 Time: 13.9436 [11/01/2021-13:42:07] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: -4420849921117327522 [11/01/2021-13:42:08] [V] [TRT] Tactic: -4420849921117327522 Time: 16.6263 [11/01/2021-13:42:08] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: -3946921629105938337 [11/01/2021-13:42:08] [V] [TRT] Tactic: -3946921629105938337 Time: 15.2929 [11/01/2021-13:42:08] [V] [TRT] Fastest Tactic: 1825138533642645384 Time: 13.2722 [11/01/2021-13:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1825138533642645384 [11/01/2021-13:42:08] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:08] [V] [TRT] --------------- Timing Runner: conv2d_4 (CudnnConvolution) [11/01/2021-13:42:08] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [11/01/2021-13:42:08] [V] [TRT] --------------- Timing Runner: conv2d_4 (CaskConvolution) [11/01/2021-13:42:08] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 861694390046228376 [11/01/2021-13:42:08] [V] [TRT] Tactic: 861694390046228376 Time: 13.7925 [11/01/2021-13:42:08] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 1017870653102653567 [11/01/2021-13:42:08] [V] [TRT] Tactic: 1017870653102653567 Time: 14.1897 [11/01/2021-13:42:08] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5258189349241541167 [11/01/2021-13:42:09] [V] [TRT] Tactic: 5258189349241541167 Time: 13.6829 [11/01/2021-13:42:09] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5821621277990374316 [11/01/2021-13:42:09] [V] [TRT] Tactic: 5821621277990374316 Time: 13.7596 [11/01/2021-13:42:09] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 5863767799113001648 [11/01/2021-13:42:09] [V] [TRT] Tactic: 5863767799113001648 Time: 14.0891 [11/01/2021-13:42:09] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -9147980667639709536 [11/01/2021-13:42:09] [V] [TRT] Tactic: -9147980667639709536 Time: 13.3053 [11/01/2021-13:42:09] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -8850904373104590857 [11/01/2021-13:42:10] [V] [TRT] Tactic: -8850904373104590857 Time: 14.0963 [11/01/2021-13:42:10] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7751035352149795660 [11/01/2021-13:42:10] [V] [TRT] Tactic: -7751035352149795660 Time: 13.6217 [11/01/2021-13:42:10] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3853827649136781465 [11/01/2021-13:42:10] [V] [TRT] Tactic: -3853827649136781465 Time: 13.4615 [11/01/2021-13:42:10] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -3263369460438823196 [11/01/2021-13:42:10] [V] [TRT] Tactic: -3263369460438823196 Time: 13.8051 [11/01/2021-13:42:10] [V] [TRT] conv2d_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: -423878181466897819 [11/01/2021-13:42:11] [V] [TRT] Tactic: -423878181466897819 Time: 14.1588 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: -9147980667639709536 Time: 13.3053 [11/01/2021-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9147980667639709536 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.318196 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.710544 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.318196 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.311092 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 1.65324 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.311092 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.510452 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.555996 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.510452 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.306092 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 1.90459 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.306092 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.503716 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.572076 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.503716 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 0.30242 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.420572 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.30242 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning format combination: Float(24576,64,8,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Transpose21 (Shuffle) [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.70878 [11/01/2021-13:42:11] [V] [TRT] Tactic: 1 Time: 0.29512 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1 Time: 0.29512 [11/01/2021-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,384) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Transpose21 (Shuffle) [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.651204 [11/01/2021-13:42:11] [V] [TRT] Tactic: 1 Time: 2.29454 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.651204 [11/01/2021-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning format combination: Float(768,64:32,8,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Transpose21 (Shuffle) [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 6.58146 [11/01/2021-13:42:11] [V] [TRT] Tactic: 1 Time: 2.53733 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1 Time: 2.53733 [11/01/2021-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 2.475 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.372772 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.372772 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 2.52366 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 6.59619 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 2.52366 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 2.56792 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 0.64874 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 0 Time: 0.64874 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:11] [V] [TRT] Tactic: 1002 Time: 1.28711 [11/01/2021-13:42:11] [V] [TRT] Tactic: 0 Time: 6.82284 [11/01/2021-13:42:11] [V] [TRT] Fastest Tactic: 1002 Time: 1.28711 [11/01/2021-13:42:11] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 2.55176 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.90314 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.90314 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 1.42478 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.417552 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.417552 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 0.48102 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.288324 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.288324 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 2.57266 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.374268 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.374268 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 2.46518 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 6.6205 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 2.46518 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 2.50742 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.648812 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.648812 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 0.282612 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.356468 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.282612 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 1.28641 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 6.93015 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 1.28641 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 2.49103 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.893568 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.893568 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 1.52493 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.419712 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 0 Time: 0.419712 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Cast) [11/01/2021-13:42:12] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Identity21 (Reformat) [11/01/2021-13:42:12] [V] [TRT] Tactic: 1002 Time: 1.51863 [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 7.34806 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 1002 Time: 1.51863 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Transpose18 (Shuffle) [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.55348 [11/01/2021-13:42:12] [V] [TRT] Tactic: 1 Time: 0.31222 [11/01/2021-13:42:12] [V] [TRT] Fastest Tactic: 1 Time: 0.31222 [11/01/2021-13:42:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:12] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:12] [V] [TRT] --------------- Timing Runner: Transpose18 (Shuffle) [11/01/2021-13:42:12] [V] [TRT] Tactic: 0 Time: 0.381368 [11/01/2021-13:42:13] [V] [TRT] Tactic: 1 Time: 2.28421 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.381368 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Transpose18 (Shuffle) [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 1.7103 [11/01/2021-13:42:13] [V] [TRT] Tactic: 1 Time: 2.42986 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 1.7103 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,64,8,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: batch_normalization_4 (Scale) [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.287784 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.287784 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,384) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: batch_normalization_4 (Scale) [11/01/2021-13:42:13] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,64,8,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Transpose19 (Shuffle) [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.764284 [11/01/2021-13:42:13] [V] [TRT] Tactic: 1 Time: 0.301248 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 1 Time: 0.301248 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,384) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Transpose19 (Shuffle) [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.657304 [11/01/2021-13:42:13] [V] [TRT] Tactic: 1 Time: 2.29698 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.657304 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(768,64:32,8,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Transpose19 (Shuffle) [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 6.88099 [11/01/2021-13:42:13] [V] [TRT] Tactic: 1 Time: 2.42765 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 1 Time: 2.42765 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 0.481244 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.292228 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.292228 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 2.4746 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.375548 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.375548 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 2.5226 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 6.55622 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 2.5226 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 2.49306 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.648432 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.648432 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 0.280116 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 0.350732 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.280116 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 1.28731 [11/01/2021-13:42:13] [V] [TRT] Tactic: 0 Time: 6.83298 [11/01/2021-13:42:13] [V] [TRT] Fastest Tactic: 1002 Time: 1.28731 [11/01/2021-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:13] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:13] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:13] [V] [TRT] Tactic: 1002 Time: 2.50161 [11/01/2021-13:42:14] [V] [TRT] Tactic: 0 Time: 0.891476 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.891476 [11/01/2021-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:14] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:14] [V] [TRT] Tactic: 1002 Time: 1.41987 [11/01/2021-13:42:14] [V] [TRT] Tactic: 0 Time: 0.41734 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.41734 [11/01/2021-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: Identity20 (Cast) [11/01/2021-13:42:14] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: Identity20 (Reformat) [11/01/2021-13:42:14] [V] [TRT] Tactic: 1002 Time: 1.37555 [11/01/2021-13:42:14] [V] [TRT] Tactic: 0 Time: 7.24239 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 1002 Time: 1.37555 [11/01/2021-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWiseV2) [11/01/2021-13:42:14] [V] [TRT] Tactic: 0 Time: 0.332604 [11/01/2021-13:42:14] [V] [TRT] Tactic: 1 Time: 0.31326 [11/01/2021-13:42:14] [V] [TRT] Tactic: 2 Time: 0.280376 [11/01/2021-13:42:14] [V] [TRT] Tactic: 3 Time: 0.305664 [11/01/2021-13:42:14] [V] [TRT] Tactic: 4 Time: 0.268044 [11/01/2021-13:42:14] [V] [TRT] Tactic: 5 Time: 0.269056 [11/01/2021-13:42:14] [V] [TRT] Tactic: 6 Time: 0.314228 [11/01/2021-13:42:14] [V] [TRT] Tactic: 7 Time: 0.269888 [11/01/2021-13:42:14] [V] [TRT] Tactic: 8 Time: 0.270948 [11/01/2021-13:42:14] [V] [TRT] Tactic: 9 Time: 0.278864 [11/01/2021-13:42:14] [V] [TRT] Tactic: 28 Time: 0.333448 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 4 Time: 0.268044 [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWise) [11/01/2021-13:42:14] [V] [TRT] Tactic: 128 Time: 1.58447 [11/01/2021-13:42:14] [V] [TRT] Tactic: 256 Time: 1.58401 [11/01/2021-13:42:14] [V] [TRT] Tactic: 512 Time: 1.58561 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 256 Time: 1.58401 [11/01/2021-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWiseV2) [11/01/2021-13:42:14] [V] [TRT] Tactic: 0 Time: 0.336268 [11/01/2021-13:42:14] [V] [TRT] Tactic: 1 Time: 0.315124 [11/01/2021-13:42:14] [V] [TRT] Tactic: 2 Time: 0.276408 [11/01/2021-13:42:14] [V] [TRT] Tactic: 3 Time: 0.310952 [11/01/2021-13:42:14] [V] [TRT] Tactic: 4 Time: 0.272508 [11/01/2021-13:42:14] [V] [TRT] Tactic: 5 Time: 0.27432 [11/01/2021-13:42:14] [V] [TRT] Tactic: 6 Time: 0.311112 [11/01/2021-13:42:14] [V] [TRT] Tactic: 7 Time: 0.276312 [11/01/2021-13:42:14] [V] [TRT] Tactic: 8 Time: 0.28094 [11/01/2021-13:42:14] [V] [TRT] Tactic: 9 Time: 0.275168 [11/01/2021-13:42:14] [V] [TRT] Tactic: 28 Time: 0.32822 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 4 Time: 0.272508 [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWise) [11/01/2021-13:42:14] [V] [TRT] Tactic: 128 Time: 1.58392 [11/01/2021-13:42:14] [V] [TRT] Tactic: 256 Time: 1.5851 [11/01/2021-13:42:14] [V] [TRT] Tactic: 512 Time: 2.01159 [11/01/2021-13:42:14] [V] [TRT] Fastest Tactic: 128 Time: 1.58392 [11/01/2021-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [11/01/2021-13:42:14] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWiseV2) [11/01/2021-13:42:14] [V] [TRT] Tactic: 24 Time: 1.82068 [11/01/2021-13:42:14] [V] [TRT] Tactic: 25 Time: 1.70568 [11/01/2021-13:42:14] [V] [TRT] Tactic: 26 Time: 1.69761 [11/01/2021-13:42:14] [V] [TRT] Tactic: 27 Time: 1.71733 [11/01/2021-13:42:15] [V] [TRT] Tactic: 31 Time: 1.75734 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 26 Time: 1.69761 [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: PWN(elu_4) (PointWise) [11/01/2021-13:42:15] [V] [TRT] Tactic: 128 Time: 6.31548 [11/01/2021-13:42:15] [V] [TRT] Tactic: 256 Time: 6.31326 [11/01/2021-13:42:15] [V] [TRT] Tactic: 512 Time: 6.31718 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 256 Time: 6.31326 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 0.48526 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 0.297636 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.297636 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 2.47512 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 0.378068 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.378068 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 2.46365 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 6.57314 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 2.46365 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 2.48873 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 0.648888 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.648888 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 0.281412 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 0.3546 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.281412 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 1.30476 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 6.94493 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 1.30476 [11/01/2021-13:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:15] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:15] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:15] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:15] [V] [TRT] Tactic: 1002 Time: 2.48999 [11/01/2021-13:42:15] [V] [TRT] Tactic: 0 Time: 0.901972 [11/01/2021-13:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.901972 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:16] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:16] [V] [TRT] Tactic: 1002 Time: 1.4813 [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 0.424604 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.424604 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Identity19 (Cast) [11/01/2021-13:42:16] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Identity19 (Reformat) [11/01/2021-13:42:16] [V] [TRT] Tactic: 1002 Time: 1.47252 [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 7.28867 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 1002 Time: 1.47252 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,3072,384,1) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,8) -> Float(3072,3072:32,384,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,3072,384,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(3072,3072:32,384,1) -> Float(24576,1,3072,8) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(24576,3072,384,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Transpose16 (Shuffle) [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 0.560568 [11/01/2021-13:42:16] [V] [TRT] Tactic: 1 Time: 0.322772 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 1 Time: 0.322772 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,8) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Transpose16 (Shuffle) [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 0.386812 [11/01/2021-13:42:16] [V] [TRT] Tactic: 1 Time: 2.34286 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.386812 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(3072,3072:32,384,1) -> Float(768,64:32,8,1) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Transpose16 (Shuffle) [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 1.97589 [11/01/2021-13:42:16] [V] [TRT] Tactic: 1 Time: 2.42824 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 0 Time: 1.97589 [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,64,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(24576,1,3072,384) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,64,8,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(768,64:32,8,1) -> Float(24576,1,3072,384) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(24576,64,8,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (CudnnDeconvolution) [11/01/2021-13:42:16] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (GemmDeconvolution) [11/01/2021-13:42:16] [V] [TRT] Tactic: 0 Time: 28.7311 [11/01/2021-13:42:16] [V] [TRT] Fastest Tactic: 0 Time: 28.7311 [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (CaskDeconvolution) [11/01/2021-13:42:16] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(24576,1,3072,384) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (CudnnDeconvolution) [11/01/2021-13:42:16] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (GemmDeconvolution) [11/01/2021-13:42:16] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: conv2d_transpose (CaskDeconvolution) [11/01/2021-13:42:16] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:16] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:16] [V] [TRT] --------------- Timing Runner: Transpose17 (Shuffle) [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 1.82686 [11/01/2021-13:42:17] [V] [TRT] Tactic: 1 Time: 0.783328 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 1 Time: 0.783328 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Transpose17 (Shuffle) [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 2.49712 [11/01/2021-13:42:17] [V] [TRT] Tactic: 1 Time: 3.14626 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 0 Time: 2.49712 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Transpose17 (Shuffle) [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 8.89524 [11/01/2021-13:42:17] [V] [TRT] Tactic: 1 Time: 3.21198 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 1 Time: 3.21198 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 1.2728 [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 0.77128 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 0 Time: 0.77128 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 3.30127 [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 1.1872 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 0 Time: 1.1872 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 3.28898 [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 9.43254 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 3.28898 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 3.37182 [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 2.05299 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 0 Time: 2.05299 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 0.734552 [11/01/2021-13:42:17] [V] [TRT] Tactic: 0 Time: 0.994268 [11/01/2021-13:42:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.734552 [11/01/2021-13:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:17] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:17] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:17] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:17] [V] [TRT] Tactic: 1002 Time: 1.71562 [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 10.0817 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 1.71562 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:18] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:18] [V] [TRT] Tactic: 1002 Time: 3.37022 [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 2.6441 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 0 Time: 2.6441 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:18] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:18] [V] [TRT] Tactic: 1002 Time: 1.86902 [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 1.09656 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 0 Time: 1.09656 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Cast) [11/01/2021-13:42:18] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Identity18 (Reformat) [11/01/2021-13:42:18] [V] [TRT] Tactic: 1002 Time: 1.91352 [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 12.6628 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 1.91352 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Transpose14 (Shuffle) [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 1.99746 [11/01/2021-13:42:18] [V] [TRT] Tactic: 1 Time: 0.78856 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 1 Time: 0.78856 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Transpose14 (Shuffle) [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 2.04656 [11/01/2021-13:42:18] [V] [TRT] Tactic: 1 Time: 3.01448 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 0 Time: 2.04656 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Transpose14 (Shuffle) [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 4.56596 [11/01/2021-13:42:18] [V] [TRT] Tactic: 1 Time: 3.20167 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 1 Time: 3.20167 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: batch_normalization_5 (Scale) [11/01/2021-13:42:18] [V] [TRT] Tactic: 0 Time: 0.729844 [11/01/2021-13:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.729844 [11/01/2021-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: batch_normalization_5 (Scale) [11/01/2021-13:42:18] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:18] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:18] [V] [TRT] --------------- Timing Runner: Transpose15 (Shuffle) [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 1.84954 [11/01/2021-13:42:19] [V] [TRT] Tactic: 1 Time: 0.794044 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 1 Time: 0.794044 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Transpose15 (Shuffle) [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 2.52396 [11/01/2021-13:42:19] [V] [TRT] Tactic: 1 Time: 3.03274 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 0 Time: 2.52396 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Transpose15 (Shuffle) [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 9.33506 [11/01/2021-13:42:19] [V] [TRT] Tactic: 1 Time: 3.21296 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 1 Time: 3.21296 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 1.28801 [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 0.788756 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.788756 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 3.31161 [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 1.0161 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 0 Time: 1.0161 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 3.2897 [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 8.85899 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 3.2897 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 3.38025 [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 1.99394 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 0 Time: 1.99394 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 0.744792 [11/01/2021-13:42:19] [V] [TRT] Tactic: 0 Time: 0.955052 [11/01/2021-13:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.744792 [11/01/2021-13:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:19] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:19] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:19] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:19] [V] [TRT] Tactic: 1002 Time: 1.71534 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 10.06 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 1002 Time: 1.71534 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 3.37206 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 2.61105 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 0 Time: 2.61105 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 1.99358 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 1.09215 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 0 Time: 1.09215 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity17 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 1.84852 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 12.3915 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 1002 Time: 1.84852 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 1.27304 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 0.803816 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 0 Time: 0.803816 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 3.30091 [11/01/2021-13:42:20] [V] [TRT] Tactic: 0 Time: 1.02128 [11/01/2021-13:42:20] [V] [TRT] Fastest Tactic: 0 Time: 1.02128 [11/01/2021-13:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:20] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:20] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:20] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:20] [V] [TRT] Tactic: 1002 Time: 3.40049 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 9.53779 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 3.40049 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 3.36909 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 2.08221 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 0 Time: 2.08221 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 0.748032 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 0.94054 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.748032 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 1.71656 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 10.7283 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 1.71656 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 3.4435 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 2.60958 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 0 Time: 2.60958 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 1.98546 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 1.11535 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 0 Time: 1.11535 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Cast) [11/01/2021-13:42:21] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Identity16 (Reformat) [11/01/2021-13:42:21] [V] [TRT] Tactic: 1002 Time: 1.84034 [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 12.5154 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 1.84034 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Transpose12 (Shuffle) [11/01/2021-13:42:21] [V] [TRT] Tactic: 0 Time: 1.81095 [11/01/2021-13:42:21] [V] [TRT] Tactic: 1 Time: 0.801116 [11/01/2021-13:42:21] [V] [TRT] Fastest Tactic: 1 Time: 0.801116 [11/01/2021-13:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:21] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:21] [V] [TRT] --------------- Timing Runner: Transpose12 (Shuffle) [11/01/2021-13:42:22] [V] [TRT] Tactic: 0 Time: 2.045 [11/01/2021-13:42:22] [V] [TRT] Tactic: 1 Time: 3.01198 [11/01/2021-13:42:22] [V] [TRT] Fastest Tactic: 0 Time: 2.045 [11/01/2021-13:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:22] [V] [TRT] --------------- Timing Runner: Transpose12 (Shuffle) [11/01/2021-13:42:22] [V] [TRT] Tactic: 0 Time: 4.55406 [11/01/2021-13:42:22] [V] [TRT] Tactic: 1 Time: 3.50734 [11/01/2021-13:42:22] [V] [TRT] Fastest Tactic: 1 Time: 3.50734 [11/01/2021-13:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:22] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:22] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (CudnnDeconvolution) [11/01/2021-13:42:23] [V] [TRT] Tactic: 0 Time: 50.4324 [11/01/2021-13:42:24] [V] [TRT] Tactic: 1 Time: 39.0364 [11/01/2021-13:42:24] [V] [TRT] Tactic: 2 Time: 47.0007 [11/01/2021-13:42:25] [V] [TRT] Tactic: 3 Time: 40.6768 [11/01/2021-13:42:26] [V] [TRT] Tactic: 4 Time: 20.5828 [11/01/2021-13:42:26] [V] [TRT] Tactic: 5 Time: 12.7713 [11/01/2021-13:42:26] [V] [TRT] Fastest Tactic: 5 Time: 12.7713 [11/01/2021-13:42:26] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (GemmDeconvolution) [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 50.0023 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 0 Time: 50.0023 [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (CaskDeconvolution) [11/01/2021-13:42:27] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 5 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (CudnnDeconvolution) [11/01/2021-13:42:27] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (GemmDeconvolution) [11/01/2021-13:42:27] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: conv2d_transpose_1 (CaskDeconvolution) [11/01/2021-13:42:27] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Transpose13 (Shuffle) [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 1.92069 [11/01/2021-13:42:27] [V] [TRT] Tactic: 1 Time: 0.792256 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 1 Time: 0.792256 [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Transpose13 (Shuffle) [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 2.52669 [11/01/2021-13:42:27] [V] [TRT] Tactic: 1 Time: 3.04325 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 0 Time: 2.52669 [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Transpose13 (Shuffle) [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 9.15702 [11/01/2021-13:42:27] [V] [TRT] Tactic: 1 Time: 3.21476 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 1 Time: 3.21476 [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:27] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:27] [V] [TRT] Tactic: 1002 Time: 1.33232 [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 0.813624 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0.813624 [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:27] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:27] [V] [TRT] Tactic: 1002 Time: 3.30005 [11/01/2021-13:42:27] [V] [TRT] Tactic: 0 Time: 1.02831 [11/01/2021-13:42:27] [V] [TRT] Fastest Tactic: 0 Time: 1.02831 [11/01/2021-13:42:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:27] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:27] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:27] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:27] [V] [TRT] Tactic: 1002 Time: 3.28853 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 9.5625 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 1002 Time: 3.28853 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 3.43222 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 2.13542 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 0 Time: 2.13542 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 0.761056 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 1.01322 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.761056 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 1.71628 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 10.0832 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.71628 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 3.37619 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 2.69327 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 0 Time: 2.69327 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 1.96048 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 1.11204 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 0 Time: 1.11204 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Cast) [11/01/2021-13:42:28] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Identity15 (Reformat) [11/01/2021-13:42:28] [V] [TRT] Tactic: 1002 Time: 1.83974 [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 12.51 [11/01/2021-13:42:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.83974 [11/01/2021-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:28] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:28] [V] [TRT] --------------- Timing Runner: Transpose10 (Shuffle) [11/01/2021-13:42:28] [V] [TRT] Tactic: 0 Time: 1.79506 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 0.781676 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 1 Time: 0.781676 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Transpose10 (Shuffle) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 2.15812 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 3.01213 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 0 Time: 2.15812 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Transpose10 (Shuffle) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 4.57825 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 3.27359 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 1 Time: 3.27359 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: batch_normalization_6 (Scale) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 0.759576 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 0 Time: 0.759576 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: batch_normalization_6 (Scale) [11/01/2021-13:42:29] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Transpose11 (Shuffle) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 2.25663 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 0.831244 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 1 Time: 0.831244 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Transpose11 (Shuffle) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 2.58857 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 3.09663 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 0 Time: 2.58857 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(2048,256:32,16,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Transpose11 (Shuffle) [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 8.8818 [11/01/2021-13:42:29] [V] [TRT] Tactic: 1 Time: 3.21209 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 1 Time: 3.21209 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:29] [V] [TRT] Tactic: 1002 Time: 1.3719 [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 0.793528 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 0 Time: 0.793528 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:29] [V] [TRT] Tactic: 1002 Time: 3.29812 [11/01/2021-13:42:29] [V] [TRT] Tactic: 0 Time: 1.25145 [11/01/2021-13:42:29] [V] [TRT] Fastest Tactic: 0 Time: 1.25145 [11/01/2021-13:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:29] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:29] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:29] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:29] [V] [TRT] Tactic: 1002 Time: 3.37405 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 8.87024 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 1002 Time: 3.37405 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 3.45222 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 1.9908 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 0 Time: 1.9908 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 0.7986 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 0.940804 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.7986 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 1.95247 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 10.1104 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 1002 Time: 1.95247 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 3.43936 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 2.65738 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 0 Time: 2.65738 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 1.89812 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 1.10966 [11/01/2021-13:42:30] [V] [TRT] Fastest Tactic: 0 Time: 1.10966 [11/01/2021-13:42:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:30] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Cast) [11/01/2021-13:42:30] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:30] [V] [TRT] --------------- Timing Runner: Identity14 (Reformat) [11/01/2021-13:42:30] [V] [TRT] Tactic: 1002 Time: 1.83811 [11/01/2021-13:42:30] [V] [TRT] Tactic: 0 Time: 12.3359 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 1002 Time: 1.83811 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 1.4245 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 0.8125 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 0 Time: 0.8125 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 3.36328 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 1.08222 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 0 Time: 1.08222 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 3.30019 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 9.37361 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 1002 Time: 3.30019 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 3.37158 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 2.04472 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 0 Time: 2.04472 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 0.741324 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 0.9433 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.741324 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 1.71574 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 10.0886 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 1002 Time: 1.71574 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 3.52692 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 2.70138 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 0 Time: 2.70138 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:31] [V] [TRT] Tactic: 1002 Time: 1.86818 [11/01/2021-13:42:31] [V] [TRT] Tactic: 0 Time: 1.10138 [11/01/2021-13:42:31] [V] [TRT] Fastest Tactic: 0 Time: 1.10138 [11/01/2021-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:31] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Cast) [11/01/2021-13:42:31] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:31] [V] [TRT] --------------- Timing Runner: Identity13 (Reformat) [11/01/2021-13:42:32] [V] [TRT] Tactic: 1002 Time: 1.90339 [11/01/2021-13:42:32] [V] [TRT] Tactic: 0 Time: 12.5609 [11/01/2021-13:42:32] [V] [TRT] Fastest Tactic: 1002 Time: 1.90339 [11/01/2021-13:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,4096,256,1) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,16) -> Float(4096,4096:32,256,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,4096,256,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(4096,4096:32,256,1) -> Float(65536,1,4096,16) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning format combination: Float(65536,4096,256,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:32] [V] [TRT] --------------- Timing Runner: Transpose8 (Shuffle) [11/01/2021-13:42:32] [V] [TRT] Tactic: 0 Time: 1.79352 [11/01/2021-13:42:32] [V] [TRT] Tactic: 1 Time: 0.844892 [11/01/2021-13:42:32] [V] [TRT] Fastest Tactic: 1 Time: 0.844892 [11/01/2021-13:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,16) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:32] [V] [TRT] --------------- Timing Runner: Transpose8 (Shuffle) [11/01/2021-13:42:32] [V] [TRT] Tactic: 0 Time: 1.98251 [11/01/2021-13:42:32] [V] [TRT] Tactic: 1 Time: 3.20627 [11/01/2021-13:42:32] [V] [TRT] Fastest Tactic: 0 Time: 1.98251 [11/01/2021-13:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning format combination: Float(4096,4096:32,256,1) -> Float(2048,256:32,16,1) *************** [11/01/2021-13:42:32] [V] [TRT] --------------- Timing Runner: Transpose8 (Shuffle) [11/01/2021-13:42:32] [V] [TRT] Tactic: 0 Time: 4.57738 [11/01/2021-13:42:32] [V] [TRT] Tactic: 1 Time: 3.26252 [11/01/2021-13:42:32] [V] [TRT] Fastest Tactic: 1 Time: 3.26252 [11/01/2021-13:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,256,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(65536,1,4096,256) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,256,16,1) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning Reformat:Float(2048,256:32,16,1) -> Float(65536,1,4096,256) *************** [11/01/2021-13:42:32] [V] [TRT] *************** Autotuning format combination: Float(65536,256,16,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:32] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (CudnnDeconvolution) [11/01/2021-13:42:32] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:32] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (GemmDeconvolution) [11/01/2021-13:42:33] [V] [TRT] Tactic: 0 Time: 61.1568 [11/01/2021-13:42:33] [V] [TRT] Fastest Tactic: 0 Time: 61.1568 [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (CaskDeconvolution) [11/01/2021-13:42:33] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning format combination: Float(65536,1,4096,256) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (CudnnDeconvolution) [11/01/2021-13:42:33] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (GemmDeconvolution) [11/01/2021-13:42:33] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: conv2d_transpose_2 (CaskDeconvolution) [11/01/2021-13:42:33] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: Transpose9 (Shuffle) [11/01/2021-13:42:33] [V] [TRT] Tactic: 0 Time: 5.38475 [11/01/2021-13:42:33] [V] [TRT] Tactic: 1 Time: 2.47957 [11/01/2021-13:42:33] [V] [TRT] Fastest Tactic: 1 Time: 2.47957 [11/01/2021-13:42:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:33] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:33] [V] [TRT] --------------- Timing Runner: Transpose9 (Shuffle) [11/01/2021-13:42:34] [V] [TRT] Tactic: 0 Time: 19.2773 [11/01/2021-13:42:34] [V] [TRT] Tactic: 1 Time: 4.5751 [11/01/2021-13:42:34] [V] [TRT] Fastest Tactic: 1 Time: 4.5751 [11/01/2021-13:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning format combination: Float(6144,1024:32,32,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Transpose9 (Shuffle) [11/01/2021-13:42:34] [V] [TRT] Tactic: 0 Time: 14.1897 [11/01/2021-13:42:34] [V] [TRT] Tactic: 1 Time: 4.75658 [11/01/2021-13:42:34] [V] [TRT] Fastest Tactic: 1 Time: 4.75658 [11/01/2021-13:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:34] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:34] [V] [TRT] Tactic: 1002 Time: 3.88896 [11/01/2021-13:42:34] [V] [TRT] Tactic: 0 Time: 2.65126 [11/01/2021-13:42:34] [V] [TRT] Fastest Tactic: 0 Time: 2.65126 [11/01/2021-13:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:34] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:34] [V] [TRT] Tactic: 1002 Time: 5.21218 [11/01/2021-13:42:34] [V] [TRT] Tactic: 0 Time: 4.15872 [11/01/2021-13:42:34] [V] [TRT] Fastest Tactic: 0 Time: 4.15872 [11/01/2021-13:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:34] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:34] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:34] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:34] [V] [TRT] Tactic: 1002 Time: 5.01081 [11/01/2021-13:42:35] [V] [TRT] Tactic: 0 Time: 14.4287 [11/01/2021-13:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 5.01081 [11/01/2021-13:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:35] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:35] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:35] [V] [TRT] Tactic: 1002 Time: 5.65007 [11/01/2021-13:42:35] [V] [TRT] Tactic: 0 Time: 11.6653 [11/01/2021-13:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 5.65007 [11/01/2021-13:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:35] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:35] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:35] [V] [TRT] Tactic: 1002 Time: 2.40623 [11/01/2021-13:42:35] [V] [TRT] Tactic: 0 Time: 3.78598 [11/01/2021-13:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 2.40623 [11/01/2021-13:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:35] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:35] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:35] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:35] [V] [TRT] Tactic: 1002 Time: 2.56783 [11/01/2021-13:42:36] [V] [TRT] Tactic: 0 Time: 25.4186 [11/01/2021-13:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 2.56783 [11/01/2021-13:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:36] [V] [TRT] Tactic: 1002 Time: 5.85282 [11/01/2021-13:42:36] [V] [TRT] Tactic: 0 Time: 11.6086 [11/01/2021-13:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 5.85282 [11/01/2021-13:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:36] [V] [TRT] Tactic: 1002 Time: 2.55575 [11/01/2021-13:42:36] [V] [TRT] Tactic: 0 Time: 3.62974 [11/01/2021-13:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 2.55575 [11/01/2021-13:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Cast) [11/01/2021-13:42:36] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Identity12 (Reformat) [11/01/2021-13:42:36] [V] [TRT] Tactic: 1002 Time: 2.66102 [11/01/2021-13:42:36] [V] [TRT] Tactic: 0 Time: 2.64017 [11/01/2021-13:42:36] [V] [TRT] Fastest Tactic: 0 Time: 2.64017 [11/01/2021-13:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:36] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:36] [V] [TRT] --------------- Timing Runner: Transpose6 (Shuffle) [11/01/2021-13:42:36] [V] [TRT] Tactic: 0 Time: 6.87816 [11/01/2021-13:42:37] [V] [TRT] Tactic: 1 Time: 2.51608 [11/01/2021-13:42:37] [V] [TRT] Fastest Tactic: 1 Time: 2.51608 [11/01/2021-13:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] --------------- Timing Runner: Transpose6 (Shuffle) [11/01/2021-13:42:37] [V] [TRT] Tactic: 0 Time: 15.8403 [11/01/2021-13:42:37] [V] [TRT] Tactic: 1 Time: 4.67456 [11/01/2021-13:42:37] [V] [TRT] Fastest Tactic: 1 Time: 4.67456 [11/01/2021-13:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] --------------- Timing Runner: Transpose6 (Shuffle) [11/01/2021-13:42:37] [V] [TRT] Tactic: 0 Time: 15.2158 [11/01/2021-13:42:37] [V] [TRT] Tactic: 1 Time: 4.73076 [11/01/2021-13:42:37] [V] [TRT] Fastest Tactic: 1 Time: 4.73076 [11/01/2021-13:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] --------------- Timing Runner: batch_normalization_7 (Scale) [11/01/2021-13:42:37] [V] [TRT] Tactic: 0 Time: 2.28313 [11/01/2021-13:42:37] [V] [TRT] Fastest Tactic: 0 Time: 2.28313 [11/01/2021-13:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] --------------- Timing Runner: batch_normalization_7 (Scale) [11/01/2021-13:42:37] [V] [TRT] Scale has no valid tactics for this config, skipping [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:37] [V] [TRT] --------------- Timing Runner: Transpose7 (Shuffle) [11/01/2021-13:42:37] [V] [TRT] Tactic: 0 Time: 5.58592 [11/01/2021-13:42:38] [V] [TRT] Tactic: 1 Time: 2.4492 [11/01/2021-13:42:38] [V] [TRT] Fastest Tactic: 1 Time: 2.4492 [11/01/2021-13:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Transpose7 (Shuffle) [11/01/2021-13:42:38] [V] [TRT] Tactic: 0 Time: 18.989 [11/01/2021-13:42:38] [V] [TRT] Tactic: 1 Time: 4.5251 [11/01/2021-13:42:38] [V] [TRT] Fastest Tactic: 1 Time: 4.5251 [11/01/2021-13:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning format combination: Float(6144,1024:32,32,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Transpose7 (Shuffle) [11/01/2021-13:42:38] [V] [TRT] Tactic: 0 Time: 14.7924 [11/01/2021-13:42:38] [V] [TRT] Tactic: 1 Time: 4.75005 [11/01/2021-13:42:38] [V] [TRT] Fastest Tactic: 1 Time: 4.75005 [11/01/2021-13:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:38] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:38] [V] [TRT] Tactic: 1002 Time: 3.85682 [11/01/2021-13:42:38] [V] [TRT] Tactic: 0 Time: 2.61736 [11/01/2021-13:42:38] [V] [TRT] Fastest Tactic: 0 Time: 2.61736 [11/01/2021-13:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:38] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:38] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:38] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:39] [V] [TRT] Tactic: 1002 Time: 4.97619 [11/01/2021-13:42:39] [V] [TRT] Tactic: 0 Time: 4.17061 [11/01/2021-13:42:39] [V] [TRT] Fastest Tactic: 0 Time: 4.17061 [11/01/2021-13:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:39] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:39] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:39] [V] [TRT] Tactic: 1002 Time: 5.0491 [11/01/2021-13:42:39] [V] [TRT] Tactic: 0 Time: 14.3686 [11/01/2021-13:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 5.0491 [11/01/2021-13:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:39] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:39] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:39] [V] [TRT] Tactic: 1002 Time: 5.34082 [11/01/2021-13:42:39] [V] [TRT] Tactic: 0 Time: 11.2293 [11/01/2021-13:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 5.34082 [11/01/2021-13:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:39] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:39] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:39] [V] [TRT] Tactic: 1002 Time: 2.47695 [11/01/2021-13:42:39] [V] [TRT] Tactic: 0 Time: 3.56858 [11/01/2021-13:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 2.47695 [11/01/2021-13:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:39] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:39] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:39] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:39] [V] [TRT] Tactic: 1002 Time: 2.49472 [11/01/2021-13:42:40] [V] [TRT] Tactic: 0 Time: 25.695 [11/01/2021-13:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 2.49472 [11/01/2021-13:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:40] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:40] [V] [TRT] Tactic: 1002 Time: 5.32821 [11/01/2021-13:42:40] [V] [TRT] Tactic: 0 Time: 11.2171 [11/01/2021-13:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 5.32821 [11/01/2021-13:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:40] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:40] [V] [TRT] Tactic: 1002 Time: 2.50658 [11/01/2021-13:42:40] [V] [TRT] Tactic: 0 Time: 3.59627 [11/01/2021-13:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 2.50658 [11/01/2021-13:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Cast) [11/01/2021-13:42:40] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity11 (Reformat) [11/01/2021-13:42:40] [V] [TRT] Tactic: 1002 Time: 2.62303 [11/01/2021-13:42:40] [V] [TRT] Tactic: 0 Time: 2.65313 [11/01/2021-13:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 2.62303 [11/01/2021-13:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:40] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:40] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:40] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:41] [V] [TRT] Tactic: 1002 Time: 3.83255 [11/01/2021-13:42:41] [V] [TRT] Tactic: 0 Time: 2.87846 [11/01/2021-13:42:41] [V] [TRT] Fastest Tactic: 0 Time: 2.87846 [11/01/2021-13:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:41] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:41] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:41] [V] [TRT] Tactic: 1002 Time: 4.9941 [11/01/2021-13:42:41] [V] [TRT] Tactic: 0 Time: 4.24111 [11/01/2021-13:42:41] [V] [TRT] Fastest Tactic: 0 Time: 4.24111 [11/01/2021-13:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [11/01/2021-13:42:41] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:41] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:41] [V] [TRT] Tactic: 1002 Time: 5.56296 [11/01/2021-13:42:41] [V] [TRT] Tactic: 0 Time: 15.4743 [11/01/2021-13:42:41] [V] [TRT] Fastest Tactic: 1002 Time: 5.56296 [11/01/2021-13:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:41] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:41] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:41] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:41] [V] [TRT] Tactic: 1002 Time: 5.3486 [11/01/2021-13:42:42] [V] [TRT] Tactic: 0 Time: 11.6354 [11/01/2021-13:42:42] [V] [TRT] Fastest Tactic: 1002 Time: 5.3486 [11/01/2021-13:42:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:42] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:42] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:42] [V] [TRT] Tactic: 1002 Time: 2.45854 [11/01/2021-13:42:42] [V] [TRT] Tactic: 0 Time: 3.46926 [11/01/2021-13:42:42] [V] [TRT] Fastest Tactic: 1002 Time: 2.45854 [11/01/2021-13:42:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:42] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:42] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:42] [V] [TRT] Tactic: 1002 Time: 2.51784 [11/01/2021-13:42:42] [V] [TRT] Tactic: 0 Time: 27.2251 [11/01/2021-13:42:42] [V] [TRT] Fastest Tactic: 1002 Time: 2.51784 [11/01/2021-13:42:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:42] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:42] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:42] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:42] [V] [TRT] Tactic: 1002 Time: 5.45074 [11/01/2021-13:42:43] [V] [TRT] Tactic: 0 Time: 10.9614 [11/01/2021-13:42:43] [V] [TRT] Fastest Tactic: 1002 Time: 5.45074 [11/01/2021-13:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:43] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:43] [V] [TRT] Tactic: 1002 Time: 2.58909 [11/01/2021-13:42:43] [V] [TRT] Tactic: 0 Time: 3.88548 [11/01/2021-13:42:43] [V] [TRT] Fastest Tactic: 1002 Time: 2.58909 [11/01/2021-13:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Identity10 (Cast) [11/01/2021-13:42:43] [V] [TRT] Cast has no valid tactics for this config, skipping [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Identity10 (Reformat) [11/01/2021-13:42:43] [V] [TRT] Tactic: 1002 Time: 2.59162 [11/01/2021-13:42:43] [V] [TRT] Tactic: 0 Time: 2.7212 [11/01/2021-13:42:43] [V] [TRT] Fastest Tactic: 1002 Time: 2.59162 [11/01/2021-13:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(196608,6144,192,1) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,32) -> Float(6144,6144:32,192,1) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,6144,192,1) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning Reformat:Float(6144,6144:32,192,1) -> Float(196608,1,6144,32) *************** [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning format combination: Float(196608,6144,192,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Transpose4 (Shuffle) [11/01/2021-13:42:43] [V] [TRT] Tactic: 0 Time: 6.45437 [11/01/2021-13:42:43] [V] [TRT] Tactic: 1 Time: 2.48081 [11/01/2021-13:42:43] [V] [TRT] Fastest Tactic: 1 Time: 2.48081 [11/01/2021-13:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,32) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Transpose4 (Shuffle) [11/01/2021-13:42:43] [V] [TRT] Tactic: 0 Time: 15.1503 [11/01/2021-13:42:43] [V] [TRT] Tactic: 1 Time: 4.47765 [11/01/2021-13:42:43] [V] [TRT] Fastest Tactic: 1 Time: 4.47765 [11/01/2021-13:42:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:43] [V] [TRT] *************** Autotuning format combination: Float(6144,6144:32,192,1) -> Float(6144,1024:32,32,1) *************** [11/01/2021-13:42:43] [V] [TRT] --------------- Timing Runner: Transpose4 (Shuffle) [11/01/2021-13:42:44] [V] [TRT] Tactic: 0 Time: 14.8079 [11/01/2021-13:42:44] [V] [TRT] Tactic: 1 Time: 4.70658 [11/01/2021-13:42:44] [V] [TRT] Fastest Tactic: 1 Time: 4.70658 [11/01/2021-13:42:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 1 [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning Reformat:Float(196608,1024,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning Reformat:Float(196608,1,6144,192) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1024,32,1) *************** [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning Reformat:Float(6144,1024:32,32,1) -> Float(196608,1,6144,192) *************** [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning format combination: Float(196608,1024,32,1) -> Float(524288,4096,64,1) *************** [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (CudnnDeconvolution) [11/01/2021-13:42:44] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (GemmDeconvolution) [11/01/2021-13:42:44] [11/01/2021-13:42:44] [11/01/2021-13:42:44] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: 3.40282e+38 [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (CaskDeconvolution) [11/01/2021-13:42:44] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:44] [V] [TRT] *************** Autotuning format combination: Float(196608,1,6144,192) -> Float(524288,1,8192,128) *************** [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (CudnnDeconvolution) [11/01/2021-13:42:44] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (GemmDeconvolution) [11/01/2021-13:42:44] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:44] [V] [TRT] --------------- Timing Runner: conv2d_transpose_3 (CaskDeconvolution) [11/01/2021-13:42:44] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [11/01/2021-13:42:44] [V] [TRT] Deleting timing cache: 80 entries, 402 hits [11/01/2021-13:42:44] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1381, GPU 7180 (MiB) [11/01/2021-13:42:44] [11/01/2021-13:42:44]